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PREFACE 



Established in 1985, California's Greater Avenues for Independence (GAIN) Program broke new 
ground by emphasizing large-scale, mandatory participation in basic education, in addition to job search, 
training, and unpaid work experience, for welfare recipients who were considered to need it. This new 
emphasis on basic education was subsequently embodied in the federal Family Support Act of 1988 and 
its centerpiece, the Job Opportunities and Basic Skills Training (JOBS) Program. The premise was that 
many welfare recipients - notably, long-term recipients, who account for the bulk of welfare spending 
- have inadequate educational backgrounds and basic skills for obtaining and keeping jobs, especially 
jobs sufficiently well-paying to enable them to leave welfare. 

This report, the seventh in the GAIN evaluation, examines how the basic education component 
of GAIN has been operating and assesses the participation patterns and educational effects for the almost 
two-thirds of the GAIN caseload who, during the period of the study, were determined to need basic 
education. It does this by tracking the experiences of more than 2,500 of these individuals over a two- 
to three-year follow-up period. 

The report concludes that the GAIN programs in the six study counties all successfully met the 
large - and unprecedented - challenge of providing basic education to great numbers of welfare 
recipients. It also shows that GAIN led to increases in the number of hours in basic education and to 
increases in receipt of a GED. However, in only one of the study counties did welfare recipients 
experience increases in scores on a test of literacy and mathematical problem-solving. Moreover, at the 
two-year point, there was as yet no link between sites with educational gains and sites with earnings gains 
(although the report argues that two years may have been too short a time for detecting earnings impacts, 
and points to evidence that earnings may have improved at the three-year follow-up point). Further, the 
report notes that educational gains were concentrated among individuals with relatively high levels of 
literacy anc: that test score gains were concentrated in the site that created a virtually new, county-wide 
adult education program tailored to the special needs of people on welfare. These results show that, 
while feasible, providing effective basic education services for this mandatory population can be difficult, 
and that longer-term follow-up will be important for detecting the full payoff of investments in education. 

Finally, it must be stressed that the present results should not be overinterpreted or used to make 
judgments as to the value of basic education for welfare recipients or for adults more generally, who 
usually seek out such services and participate in them voluntarily. 

Judith M. Gueron 
President 
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EXECUTIVE SUMMARY 



A central goal of recent federal and state welfare reform initiatives has been to assist welfare 
recipients to become employed and move toward self-sufficiency. However, as documented in several 
studies, poor basic literacy skills are a chronic problem for many of those in poverty and receiving 
welfare, diminishing their chances of competing effectively in the labor market. An important policy 
response has been to provide them with basic education ~ classes in Adult Basic Education (ABE), which 
focus on reading and mp**;ematics; preparation for the General Educational Development (GED) test; and 
instruction in English as a Second Language (ESL). 

This report presents findings about the operation and educational effects cf a welfare-to-work 
program that puts a considerable emphasis on mandatory basic education services: California's statewide 
Greater Avenues for Independence (GAIN) Program, which began operations in 1986 and is targeted to 
recipients of Aid to Families with Dependent Children (AFDC). For welfare recipients whom GAIN 
determines to need basic education - 65 percent of those GAIN served during the period of this study 
- the program emphasizes participation in basic education as a condition for receiving welfare. It must 
be stressed that this is not an evaluation of adult education services as they are normally delivered: to 
people who seek them out and participate in them voluntarily. 

GAIN broke new ground by mandating basic education for large numbers of people. In giving 
basic education a prominent role, and in other respects as well, GAIN was an important precursor of 
federal welfare reform legislation ~ the Family Support Act of 1988 and its centerpiece, the Job 
Opportunities and Basic Skills Training (JOBS) Program, which is the major source of federal funding 
for state welfare-to-work programs. Lessons on the operation and effects of GAIN are relevant to welfare 
reform broadly because California has the country's biggest AFDC caseload and GAIN is the largest and 
one of the most ambitious of all the states' JOBS programs. It is also one of few cuch programs to 
mandate basic education for large numbers of welfare recipients. 

This is the seventh in a series of reports from an ongoing random assignment evaluation of 
GAIN'S effectiveness, which is being conducted by the Manpower Demonstration Research Corporation 
(MDRC) under a contract from the California Department of Social Services (CDSS).^ Six California 
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counties are included in the evaluation: Alameda, Butte, Los Angeles, Riverside, San Diego, and Tulare. 
Together, they account for more than one-third of the state's GAIN caseload and more than one-half of 
its AFDC caseload. The present report is based mainly on a sample of more than 2,500 welfare 
recipients, in five of those six counties (all but Butte), who met GAIN'S criteria for needing basic 
education. They include both single heads of families with children age six or older (AFDC-FGs, who 
are usually mothers) and heads of two-parent families (AFDC-Us, who are typically fathers).^ These 
individuals became part of the evaluation's research sample between March 1988 and June 1990, and the 
descriptions of county programs apply to the way they were operated prior to mid- 1991. The report 
draws on previously completed analyses and also presents new data based on a survey of these recipients 
and the results of a literacy test, both of which were administered to them two to three years after they 
became part of the research sample.^ This summary focuses primarily on the results for the AFDC-FG 
(single-parent) registrants, who constitute a large majority of AFDC recipients. 

Highlights of the Findings 

The feasibUity of providing basic education through GAIN. All six of the California counties 
in the GAIN evaluation were able to operate the program's basic education component on a relatively 
large scale. The county GAIN programs established the necessary linkages with schools, and the schools 
were able to enroll the new population of mandatory GAIN participants, provide them with classes that 
offered an "opportunity to learn" (as measured by conventional standards), and, for the most part, 
monitor students' attendance and performance. In San Diego, a major effort was made to tailor the 
services to the specific needs of GAIN participants by creating a new county-wide education program to 
serve them exclusively. 

Rates and duration of participation in basic education. Fifty-eight percent of GAIN registrants 
determined to need basic education were referred by GAIN to a basic education program. Of those 
referred, 71 percent (41 percent of all those judged to need basic education) actually attended such a 



*(... continued) 

Friedlander, GAIN: Program Strategies, Participation Patterns, and First-Year Impacts in Six Counties (New York: 
MDRC. 1992); and Daniel Friedlander. James Riccio, and Stephen Freedman, GAIN: Two-Year Impacts in Six 
Counties (New York: MDRC, 1993). 

^Thc research sample does not include AFDC-FGs (single parents) with preschool-age children, many of whom 
become mandatoiy for GAIN under JOBS regulations in 1989. 

^It is beyond the scope of this report to discuss GAIN'S impacts on employment and welfare receipt over a 
longer follow-up period than has been presented in previous reporu (most recently in Friedlander, Riccio. and 
Freedman, 1993) or to link the education outcomes to labor market results. Analysis of these issues will be 
addressed in the evaluation's final report, scheduled for 1994. 
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program. Those who were not referred - or, if they were referred, did not attend - fell into several 
categories. Many were temporarily excused from GAIN or had left GAIN because they became 
employed, experienced health problems, or had other reasons that were acceptable according to the GAIN 
legislation. Others were referred to activities other than basic education, primarily job search. Still 
others were continuing, with GAIN'S approval, in post-secondary or vocational education and training 
activities they had begun prior to entering GAIN. The GAIN program provided a considerable amount 
of basic education: Those who participated attended classes for roughly eight months, on average, during 
a two- to three-year follow-up period. However, participants were in class for only about 60 percent of 
their scheduled hours, on average, indicating that, even with intensive monitoring procedures, attendance 
was not consistent. 

GAINES education impacts. This report considers two kinds of education outcomes, based on a 
study in five of the six evaluation counties. (Butte was not included in this part of the research because 
resources for survey and test administration were limited.) One outcome is educational attainmenty 
which, in the context of this study, refers to passing the GED test"* (or, in some cases, receiving a high 
school diploma). The other is educational achievement, which (again in the present context) denotes an 
increase in literacy and mathematical skills as gauged by scores on a literacy test. In the five counties, 
the educational effects (or "impacts") of GAIN were measured by comparing the educational attainment 
and achievement of two groups of welfare recipients: one group (the experimental group), who were 
given access to GAIN'S services and were subject to its participation mandate, and another, similar group 
of welfare recipients (the control group), who were not eligible for the program and were not subject to 
its participation mandate, but who could participate in other services in the community on their own. It 
is very important to note that, as discussed above, many experimental group members did not participate 
in the basic education services provided through GAIN. However, the impacts in this report pertain to 
the entire group determined to need basic education - both those who participated and those who did not. 

Impacts on attainment of a GED. GAIN was successful in increasing GED receipt for program 
registrants in all five counties that were in the study of GAIN'S education impacts. The impacts in four 
of these counties were statistically significant. Tulare produced a very large (19 percentage point) impact 
and Alameda produced a relatively large (8 percentage point) impact; the impacts in Los Angeles and 
Riverside were small; and San Diego's impact (4 percentage points) was in the middle. The GED 
impacts were concentrated among the individuals who were the most literate when they entered GAIN. 
For them, GAIN appears to have provided an accessible route for acquiring relatively quickly the specific 



"^Individuals who pass the GED test receive a state high school equivalency certificate. 
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knowledge needed to pass the GED test. Those at lower literacy levels tended to participate in ABE (i.e., 
remedial reading and mathematics) classes; relatively few of them entered GED preparation programs. 

Impacts on literacy test scores. This study also analyzed whether GAIN increased the basic skills 
levels of welfare recipients as measured using a literacy test - the Test of Applied Literacy Skills 
(TALS). (The test was administered only in English, so those individuals in the sample who were not 
proficient in English were not tested.) San Diego's GAIN program produced large and statistically 
significant impacts on TALS scores. No other county produced measurable impacts, and there was no 
impact for all counties combined, although small test score gains may have gone undetected. As was true 
of the GED impacts, basic skills increases were concentrated among individuals who had the highest 
levels of literacy when they entered GAIN; these were also individuals who spent relatively shorter 
periods of time in basic education classes. It is possible that those at lower literacy levels may have made 
gains that were not captured by the TALS, or perhaps this group may need more than the considerable 
amount of education they received to substantially improve their skills. Nonetheless, the results raise 
questions abour whether the basic education services provided through GAIN were appropriate for less 
literate students. 

The results from San Diego and Tulare offer evidence that it is feasible for large-scale, mandatory 
JOBS programs to produce a substantial impact on GED receipt and basic skills levels. Both counties 
made special efforts to gear their programs specifically toward the educational needs and circumstances 
of welfare recipients. The contrasting results for ttie other counties suggest that achieving education 
impacts, although possible, may require strenuous efforts to identify, implement, and maintain effective 
program practices. 

In the three counties that produced modest to large impacts on GED receipt or basic skills levels 
- Alameda, San Diego, and Tulare - the GAIN program, in the short run (i.e., within the available 
two-year follow-up period), did not result in en^loyment and earnings impacts for those determined to 
need basic education. However, in Alameda and Tulare, results for a small group of these individuals 
who became part of the research san^le early on, and for whom there are three years of follow-up data, 
suggest a possible growth in earnings impacts beginning just after the second year of follow-up and 
increasing into the third. Results from longer follow-up, which will be presented in the evaluation's final 
report, will clarify whether GAIN'S investment in basic education shows promise of paying off in the 
labor market. 
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The GAIN Model 

GAIN is overseen by CDSS and administered by California's 58 counties. A key feature of the 
program is its use of the education and basic skills levels of welfare recipients to sort them into one of 
two treatment streams. Those who do not have a GED certificate or a high school diploma, or who fail 
to achieve a minimum score of at least 215 on both a reading test and a mathematics test (the CAS AS 
tests, developed by the Comprehensive Adult Student Assessment System), or who are not proficient in 
English are defined as "in need of basic education" and are required to attend a basic education program. 
They may choose to participate in job search first, but if they do not find a job, they must then participate 
ih basic education. 

The other registrants - those determined to be ''not in need of basic education" - usually must 
participate in job search first. Registrants who are already enrolled in education or training programs 
when they enter GAIN may continue if the programs meet certain criteria. Participants who do not find 
employment after completing their initial activities undergo an employability assessment designed to help 
them choose their next activity: skills training, vocationally oriented post-secondary education, on-the-job 
training, or unpaid work experience. Registrants who do not participate in their assigned activities are 
subject to a "sanction," i.e., a reduction in their welfare grant. 

For those determined to need basic education, three types of basic education are available through 
GAIN: (1) ABE programs, which provide remedial reading and mathematics for those with lower skills 
levels (typically at or below the eighth-grade level), (2) GED preparation programs for students whose 
academic skills are strong enough to allow them to study productively for the GED test, and (3) ESL 
instruction, which teaches people who are not proficient in English to read and speak the language. 

The Policy Context 

GAIN represented a new approach to welfare reform — one that emphasized large-scale mandatory 
participation in basic education services in addition to the job search and unpaid work experience 
components that were the focus of most welfare employment programs in the 1980s. While the earlier 
programs produced modest increases in earnings and reductions in welfare receipt, and did so cost- 
effectively, they did not move substantial numbers of people off welfare. Moreover, those who did leave 
welfare often remained poor. Studies also suggest that programs that provided primarily job search 
assistance often were unable to increase the earnings of the most disadvantaged. 

GAIN, in contrast, was structured so that, rather than seeking work immediately, participants who 
were considered to need basic education would "invest" in those activities in anticipation of future 
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economic gains. Since education has been shown to be strongly correlated with income, policymakers 
reasoned that this approach, although more expensive in the short run, would lower the costs of welfare 
in the long run by increasing departures from AFDC, especially if the more disadvantaged recipients 
thereby left welfare, and by reducing the rate at which former recipients returned to the welfare rolls. 

Previous studies, however, offer little guidance about whether a large-scale welfare-to-work 
program that emphasizes mandatory participation in basic education would be feasible to operate or 
effective. Historically, adult education programs have been geared toward individuals who voluntarily 
enrolled and were motivated to return to school. In contrast, many GAIN registrants have had negative 
experiences in school, including school failure and dropping out, and may be reluctant to return. Schools 
and the GAIN program faced many challenges in working with this new population of mandatory students 
- what types of services to offer, how much education to provide, and how to monitor and encourage 
attendance. This report is intended to inform some of these issues regarding the operation and effects 
of basic education in the GAIN program. 

The GAIN Evaluation 

The GAIN evaluation, which began in 1986, is conducted in six counties, which represent a wide 
variety of local conditions and, as noted above, account for more than one-third of the state's GAIN 
caseload and more than one-half of its AFDC caseload. Three counties are in southern California: Los 
Angeles, with about one-third of the state's AFDC caseload and a welfare population larger than that of 
all but a few states'; San Diego, with the state's second-largest AFDC caseload; and Riverside, a large 
county encompassing both urban and rural areas. Two counties are in northern California: Alameda, an 
urban county that includes the City of Oakland, and, further north, the mid-sized county of Butte. The 
final county, Tulare, is located in the largely agricultural, rural Central Valley. 

It is worth reiterating that this report's descriptions of the counties' strategies for implementing 
GAIN are based on data collected no later than mid-1991, and prior to that in most cases. This is the 
relevant information for describing the "treatment" those in the research sample experienced. However, 
some of the information does not portray the counties' current modes of operating GAIN. All of the 
counties have continued to revise their strategies as they have become more experienced in operating this 
very complex welfare-to-work initiative, and in response to changes in funding and other circumstances. 

The evaluation uses a random assignment research design to assej^s the GAIN program. In this 
design, all mandatory registrants who were referred to the GAIN program in the research counties from 
March 1988 to June 1990 were assigned, at random, to the experimental group or the control group. 
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Because registrants were assigned to these two groups at random, there were no systematic differences 
between them except for the fact that one group was subject to the GAIN mandate and the other was not. 
Thus, as the evaluation tracks members of the two groups over time, any measured differences between 
them in the amount of education received, educational attainment and achievement, employment, or 
AFDC receipt can be attributed with confidence to GAIN. 

During the period in which members of the research sample registered for GAIN, four of the six 
counties had sufficient resources to extend the program's requirements and services to all registrants in 
their caseload who were mandatory for GAIN uiider the pre-JOBS rules. The other counties - Alameda 
and Los Angeles - focused exclusively on long-term recipients. 

As already noted, this repon focuses exclusively on one group of welfare recipients from the 
overall GAIN evaluation: those determined to need basic education. The GAIN evaluation's analysis of 
welfare and employment impacts is based on a research sample of approximately 33,000 GAIN-mandatory 
AFDC-FGs and AFDC-Us, from the six research counties, who were randomly assigned to the 
experimental or control group. Of this number, roughly 21 ,000 were determined to need basic education. 
To collect information on participation in basic education and receipt of a GED or a high school diploma, 
MDRC surveyed a subset of approximately 2,500 of these 21,000 welfare recipients (both experimental 
and controls) in five of the six counties (all but Butte) two to three years after random assignment. To 
measure educational achievement, a literacy test was administered at the time of the survey to about 1 , 100 
of these 2,500 individuals. The test used in this analysis consists of two sections of the Test of Applied 
Literacy Skills (TALS), developed by the Educational Testing Service (ETS). The TALS uses written 
materials of the son encountered in everyday life - such as schedules, maps, and want ads - to gauge 
the test-taker's ability to understand such materials and to solve problems based on them (the problems 
in the quantitative part of the test require arithmetic solutions). After consultation with experts, the TALS 
was selected for the evaluation because of its appropriateness for disadvantaged adults and its high 
statistical reliability. Also, because a version of this test has been used in a recent national literacy 
assessment, use of the TALS makes it possible to compare the scores of GAIN registrants to those of 
other groups. The study also relies on data from GAIN casefiles, school attendance records, and field 
research. 

Interpreting the Results of This Study 

In weighing the evidence about GAIN'S education effects provided in this report, it is important 
to understand the kinds of questions this study was and was not designed to answer, the inherent difficulty 
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of measuring educational achievement, and, therefore, the importance of using caution in attempting to 
generalize these findings to other JOBS or basic education programs. 

First, as discussed above, the GAIN program mandates basic education for large numbers of 
welfare recipients. This distinguishes it from most other JOBS programs, which provide basic education 
only to those who choose this activity. The effects of basic education for those who volunteer may be 
quite different from tlie effects for those who are required to participate if they are to avoid the possible 
loss of part of their AFDC grant. In particular, these results do not represent JOBS programs tiiat offer 
basic education on a more selective basis or adult education programs that provide services to a non- 
welfare population. 

Second, this report does not evaluate basic education activities alone. Rather, it examines the 
effects of the entire package of GAIN'S services and mandates for those who were determined to need 
basic education. Basic education is the most important activity in this package, but not all who were 
judged to need it participated. In this report, basic education impacts are averaged over the full "in need 
of basic education" sample - those who participated in basic education (for both long and short periods) 
as well as those who did not. 

Third, this report examines only two of the effects of basic education in a JOBS program: 
increased basic skills and attainment of a GED or a high school diploma. It does not measure other 
possible effects of basic education, such as the improved well-being of participants' children, a better- 
informed citizenry, or increased self-esteem. This study also contains no information on the costs of 
providing basic education in GAIN, which will be examined in the final evaluation report. 

Fourth, the question of increased educational achievement is addressed but not answered 
definitively by this study owing to measurement issues. Unlike attainment of a credential (such as a 
GED), educational achievement is difficult to define and measure. Although the TALS is considered a 
good indicator of the skills needed to accomplish tasks in everyday life or in the workplace, it may have 
some limitations. While the TALS was designed to measure performance across a broad range of literacy 
levels, it is possible that the TALS was not sensitive enough to pick up achievement gains among those 
at very low literacy levels. It may also be that the TALS measures skills that are different from those 
that were taught and learned in GAIN basic education classes. The effects of unmeasured increases in 
skills may show up later in earnings gains. 

The size of the TALS sample also limits the ability of the study to measure educational 
achievement. The testing was intended to measure achievement impacts for the sample as a whole, not 
for individual counties or subgroups. Because the sample sizes for the test score analysis for counties 
or subgroups are small, these estimates r^n only describe the direction and approximate order of 
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magnitude of county and subgroup impacts, not their precise amounts. In addition, the sample is not 
large enough to capture small educational gains. It is possible that achievement gains of a policy-relevant 
magnitude were made by some of those who participated in basic education, but by too few to appear 
clearly in the overall experimental-control comparison. 

Finally, the motivation of sample members to score high on the tests needs to be considered. 
TALS test-takers did not face the same incentives as GED test-takers. Passing the GED test is seen by 
most GED test-takers as a step toward obtaining higher earnings. However, TALS test-takers may have 
been less motivated to do their best. This may have been particularly true for those at lower literacy 
levels, for whom any academic skills test would present a difficult challenge. 

Findings on the Basic Education Services and Systems 

• The adult education systems were able to accommodate the GAIN students 
and to provide them with an "opportunity to learn." The students usually 
recciived the same services available to other adults in the community. 

The six counties were able to accommodate the influx of GAIN students primarily by relying on 
the existing education services in the community and in some cases by expanding them. This was 
possible, in part, because California has the nation's largest adult education system. Typically, GAIN 
students were offered the standard basic education programs available to other adult education students 
in the community, and few changes were made in the services previously provided. ABE and ESL 
classes generally used individualized instruction. GED programs focused exclusively on the GED test. 

"Opportunity to learn" is a concept education analysts often use when they attempt to gauge the 
quality of education programs. MDRC's field research indicates that, by conventional standards, the 
education programs in all six counties provided such an opportunity: There were very few capacity 
problems, so students could receive services; the services were geared toward individuals' educational 
needs and used established methods and curricula; and the classes were held for a sizable number of hours 
per week (usually 15 to 20) on a continuing basis. 

• In San Diego, the basic education services were redesigned on a county-wide 
basis specifically to meet the needs of GAIN students* 

In San Diego, and in a few schools elsewhere, efforts were made to improve the basic education 
services provided to GAIN students through the use of both additional funding and different curricula and 
instructional methods. San Diego's program was built on the premise that the existing adult education 
services were not appropriate for the GAIN population because of their previous negative experiences in 
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school. The new program was designed and funded by a consortium of agencies - school districts, the 
welfare department, and the Private Industry Council (PIC). It consist.ed of an entirely new network of 
Learning Centers (i.e., classrooms) designed specifically and exclusively for GAIN students. Key 
features included up-to-date computer-assisted learning combined with classroom instruction, integrated 
academic and life skills instruction, off-campus classroom locations to reinforce the idea of a fresh 
opportunity, a new teaching staff, and a class for learning disabled students. In an effort to enhance 
accountability, another county. Riverside, developed and funded performance-based payments '^^ith several 
schools for the provision of basic education services. 

• Schools and the county GAIN programs found it difficult to establish reliable 
attendance reporting systems, which were needed to monitor and enforce 
registrants* participation. However, these systems developed and improved 
over time. 

GAIN'S participation mandate required registrants to attend their assigned activities on a 
continuous basis until they left or were officially excused from the GAIN program. This meant that 
schools had to establish new procedures for monitoring attendance and performance, and for 
communicating this information to the GAIN program. A number of schools and counties found the new 
reporting systems to be very burdensome and experienced difficulty producing timely information on 
registrants who were experiencing participation problems. 

Some counties eventually overcame these difficulties by dedicating resources specifically for 
intensive monitoring systems. Two counties stand out in their efforts to improve attendance. In San 
Diego, designated case managers were given caseloads consisting only of individuals assigned to basic 
education activities. These case managers spent two or three days a week at schools, assisting 
participants and trying to resolve attendance problems. In addition, school staff in San Diego contacted 
absent students, usually on the very day of the absence. In Tulare, the GAIN program employed 
"transition counselors," whose primary responsibility was to achieve good attendance among GAIN 
students. Tulare also established a uniform attendance monitoring system for all schools; several schools 
called participants each day they did not attend to see if the schools could remove barriers or resolve 
problems. 

During the study period, Riverside adopted a somewhat different approach. As discussed in 
previous MDRC reports. Riverside's GAIN program had a strong emphasis on quick entry into the labor 
market. Consistent with this emphasis, registrants who were not attending regularly were sometimes 
transferred from a basic education activity to a job search activity - i.e., those with poor attendance were 
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urged to find jobs if they did not want to attend school. While not a uniform policy, such transfers 
occurred more often in Riverside than in the other counties. 

Findings on Participation Patterns in Basic Education 

This discussion of participation patterns is based on (1) GAIN casefiles and attendance records 
from education providers, covering an 1 1-month follow-up period, and (2) a survey of sample members, 
covering a two- to three-year follow-up period. (The survey, as noted above, did not include Butte.) 

• A sizable propordon - 41 percent - of the AFDC-FG GAIN registrants who 
were determined to need basic education actually attended a basic education 
program within an 11-month follow-up period. Participation rates varied 
substantially among the counties. 

Figure 1 shows the participation patterns (averaged across the six counties) for a typical group of 
100 AFDC-FG GAIN registrants who were determined to need basic education. Fifty-eight of 100 
registrants were referred to an education activity, and 41 (71 percent of the 58) participated in the activity 
within an 11-month follow-up period. The participation rates were highest in Alameda, Los Angeles, 
and Tulare (ranging from 45 to 55 percent). Similar rates were found for AFDC-U registrants. 

Reflecting its more disadvantaged and non-English-speaking GAIN population, Los Angeles had 
a low proportion of participants in GED and a large proportion in ESL. In contrast, Tulare had a 
relatively large proportion of registrants attending GED programs. 

• The principal reasons for nonparticipation in basic education were consistent 
with the GAIN legislation. Therefore, in some counties, much higher rates 
of participation would not have been feasible. 

As shown in Figure 1 (i.e., in the "not referred to basic education" and "did not participate in 
basic education" boxes), there were two primary reasons for not participating in basic education 
programs. First, many registrants did not enter an education activity within the 11-month follow-up 
period because they were temporarily deferred from the GAIN program; they had a part-time job, a 
temporary illness, or another situation that precluded their attending an activity. Second, some registrants 
left the GAIN program (i.e., they were deregistered) before they participated in a basic education activity 
because they obtained a full-time job, became chronically ill, or left AFDC. Also, some registrants chose 
or were referred to another service, particularly job search. This occurred most commonly in Riverside 
and San Diego. Still other registrants fulfilled the participation mandate by continuing, with GAIN'S 
approval, in "self-initiated" post-secondary or vocational education or training activities. 
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FIGURE 1 



CLIENT FLOW WITHIN AN ll-MONTH FOLLOW-UP PERIOD 
FOR 100 TYPICAL AFDC-FG REGISTRANTS 
DETERMINED TO NEED BASIC EDUCATION 
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100 



Referred to 
Basic Education 
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Basic Education 

41 



Not Referred to 




Basic Education 




Deferred 


19 


Deregistered 


11 


Referred to Job Club or Job Search 
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In Self-Initiated Activity 
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Other 


3 



Did Not Participate in 




Basic Education 




Deferred 
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Deregistered 


5 


Referred to Job Club or Job Search 


4 


Participated After Follow-Up Period 


3 


Other 


2 



Completed 
Basic Education 

8 



Still Active in 
Basic Education 
at End of Follow-Up 

8 



Stopped Attending, 
But Did Not Complete 
Basic Education 

25 



Next Activity or Status 

Deferred 0 

Deregistered 0 

Referred to Job Club or Job Search 5 

Referred to Post-Secondary Education 1 

In GAIN, No Activity or Status 2 



Next Activity or Status 

Deferred g 

Deregistered 7 

Referred to Job Club or Job Search 2 

Referred to Post-Secondary Education 1 

In GAIN, No Activity or Status 6 
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• Twenty percent of those who participated in basic education completed their 
activities within an 11-month follow-up period. Approximately 60 percent 
stopped attending without completing the activity. The remaining 20 percent 
were stUl participating in the activity at the end of the follow-up period. 

At the time this study was conducted, the state provided only broad guidelines for determining 
when participants had completed basic education in GAIN, and individual schools and counties developed 
their own completion standards. (Statewide completion standards were developed and implemented later.) 
Only in GED programs, where the program is completed when the registrants pass the GED test, were 
the completion standards clear. No similar guidelines existed for ABE and ESL courses. Los Angeles 
and San Diego were the only programs with uniform county-wide exit procedures for ABE and ESL 
(using a specified score on a standardized test as the exit criterion). 

Figure 1 shows what happened to AFDC-FG registrants once they started a basic education 
activity. Within an 11-month period, 8 of 41 (20 percent) completed their education activity (according 
to school records), with most of these individuals going on to a job search activity; 25 of 41 (61 percent) 
stopped attending the basic education activity without finishing it, usually because they were deferred or 
deregistered from GAIN for reasons such as employment or health problems; and 8 of 41 (20 percent) 
were still participating in the activity at the end of the 1 1 -month follow-up period. These completion and 
exit rates will have changed somewhat as participants continued to complete or leave basic education 
activities after the 11 -month follow-up period covered in this analysis. 

San Diego had the highest completion rate, with close to 40 percent of its participants completing 
their ABE or GED activities.^ The county's concrete and uniform exit standards may have been a factor 
in achieving these rates, since teachers and participants were working toward a well-defined goal. 

• Basic education participants reported that they attended their basic education 
programs for roughly one school year (8 months) over a two- to three-year 
follow-up period. 

Measures of length of stay are important from a policy perspective because they represent one way 
of gauging the "investment" made by GAIN in human capital development. Table 1 presents the average 
number of months basic education participants attended their programs, according to their responses on 
the survey. AFDC-FG participants attended their activities for longer periods in Alameda, Los Angeles, 
and Tulare (ranging from 9 to 11 months) than in Riverside and San Diego (6 months). (Again, Butte 
was not included in the survey.) AFDC-U participants attended for slightly longer than did AFDC-FGs. 



^Completion data were not available in Alameda or Los Angeles. 
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TABLE 1 



FOR BASIC EDUCATION PARTICIPANTS: 
NUMBER OF MONTHS ATTENDING AND AVERAGE WEEKLY SCHEDULED HOURS IN 
BASIC EDUCATION ACTIVITIES. WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD 











AFDC-FGs 






AFDC-Us 


Measure 


Alameda 


Los 
Anqeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


All 

Counties 


Average number 
of months In basic 
education activities 


8.7 


11.3 


5.5 


5.6 


9.1 


8.0 


8.8 


Percentage distribution 
of number of months in 
basic education activities 

Less than 2 months 

2-6 months 

7-12 months 

13-18 months 

19-24 months 

25 months or more 


8.3 
43.5 
26.9 
13.0 
3.7 
4.7 


9.4 
25.0 
34.4 
10.9 
15.6 

4.7 


52.0 
17.3 
1.3 
4.0 
1.3 


52.9 
14.7 
5.9 
2.9 
0.0 


1 O.O 

31.3 
31.3 
10.0 
12.5 
1.3 


1 O.O 

40.9 
24.9 
8.2 
7.8 
2.4 


19.0 
30.5 
32.9 
6.1 
1.8 
9.8 


Average weei<ly scheduled 
hours in basic education 
activities 


15.9 


24.2 


17.7 


24.1 


17.4 


19.8 


19.5 


Sample size 


108 


64 


75 


68 


80 


395 


44 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Basic education activities include GED preparation, ABE, and ESL. 

The AFDC-U sample does not include any registrants from Alameda. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 
Distributions may not add to 100.0 percent because of rounding. 
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Almost 60 percent of the AFDC-FG participants stayed less than 6 months, and 18 percent attended for 
a year or more. ABE/GED panicipants attended for an average of 8 months,^ while ESL participants 
attended longf r, averaging 10 months over the two- to three-year follow-up period (not shown in the 
table). 

The county differences in length of stay reflect both program practices and the nature of the 
caseload each county served. Alameda and Los Angeles ser\'ed long-term AFDC recipients exclusively. 
These recipients tended to stay on welfare for longer periods during the follow-up period and thus were 
available to participate in basic education longer. In addition, the programs in these counties, as well as 
in Tulare, placed more emphasis on maintaining participation in education activities. In contrast, 
Riverside's program urged registrants to enter the labor market quickly, which contributed to the shorter 
stays in education programs in this county. 

• More disadvantaged groups — those at lower literacy levels when they entered 
GAIN and long-term AFDC recipients - reported that they attended their 
basic education activities for a longer period of time than did less 
disadvantaged groups. 

Those who scored below 215 on both the reading and mathematics CAS AS tests when they entered 
GAIN participated in ABE/GED for a significantly longer period than did those who scored higher (9 
versus 6 months). Those who had been on AFDC for two years or more also had longer stays in basic 
education than did short-term recipients or AFDC applicants. This indicates that stays will be particularly 
long for those at lower economic and education levels, because they require more education and also tend 
to stay on welfare, and thus in GAIN, longer. 

• Basic education participants reported that their classes were scheduled for 16 
to 24 hours per week. Los Angeles and San Diego represented the top of that 
range. 

Basic education participants in Alameda, Riverside, and Tulare reported on the survey that their 
education classes were scheduled for 16 to 18 hours per week, whereas participants in San Diego and Los 
Angeles reported scheduled hours of 24 per week. It is important to note the intensity of the program 
in San Diego. As stated above, San Diego participants stayed in basic eduction activities for a shorter 
time than did those in three of the other counties. However, because the San Diego participants had more 
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^The survey did not distinguish between ABE and GED activities. 

''According to CASAS, those who function below 215 are at low literacy levels and have difficulty pursuing 
programs or jobs other than those that require only minimal literacy skills. Those at or above the 215 level are able 
to handle tasks requiring basic literacy and computational skills. 
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scheduled hours per week, they were enrolled for about as many total hours of education as were 
participants in most counties that averaged longer stays in basic education (not shown in the table). Los 
Angeles, with a relatively long length of stay and a relatively high number of scheduled hours per week, 
stands out as having provided the largest amount of basic education. 

• Basic education participants were in the classroom for 10 hours per week, on 
average - roughly 60 percent of their scheduled hours. Weekly attendance 
was higher (16 hours per week) in San Diego, where classes were scheduled 
for more hours per week and more intensive monitoring was provided. 

The investment in basic education can also be gauged by the regularity of school attendance. 
Actual weekly hours in the classroom ranged from 55 to 65 percent of scheduled hours across three of 
the study counties - Riverside, San Diego, and Tulare.^ San Diego, which had intensive monitoring 
procedures, achieved the highest attendance rate of the three. In a mandatory basic education program 
for welfare recipients, such monitoring procedures may be required to achieve even these moderate rates 
of attendance. It also appears to be important to organize instruction so that it is beneficial even when 
attendance is inconsistent - i.e., so that students who miss some classes are still able to profit from the 
instruction. 

Findings on GAIN^s Impacts on Participation in Basic Education and on Education Outcomes 

As discussed earlier, to determine GAIN*s educational effects, the experience of registrants who 
were randomly assigned to the experimental group was compared to that of registrants who were 
randomly assigned to the control group. The differences between the two groups - in terms of 
participation in basic education, educational attainment, and educational achievement - represent the 
education impacts of the program. 

• Among those determined to need basic education, GAIN substantially 
increased the proportion of experimental group members who participated in 
such activities. Few control group members participated in basic education. 

Previous research on welfare-to-work programs has shown that some welfare recipients participate 
in education programs on their own initiative. Understanding how much GAIN increased participation 
beyond what registrants do on their own is important for interpreting the education impacts presented in 
this report. Across all five counties in the survey, GAIN was successful in producing large increases in 
the number of individuals who received basic education, above and beyond the number who received the 



^These calculations could not be made for Alameda, Butte, or Los Angeles because of data limitations, 
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sen'ice in the absence of the program. As shown in Table 2, 44 percent of the AFDC-FG experimentals 
reported that they participated in ABE/GED compared to 8 percent of the controls, for a difference of 
35 percentage points.^ Some members of the experimental group also participated in the job search and 
unpaid work experience activities offered through GAIN, which were not available to control group 
members. GAIN did not influence the degree to which post-secondary education or vocational training 
was used above and beyonu what individuals did on their own (not shown in the table). 

As noted above, those who attended a basic education program received a substantial amount of 
education. GAIN'S impact on the amount received is measured by comparing the average length of stay 
in basic education for the experimental and control groups, including sample members who did not 
participate in those activities (they are counted as zero in the averages). This comparison shows that, 
over the course of the two- to three-year follow-up period, experimentals participated for an average of 
2.4 months, while controls averaged only 0.4 months. These impacts were largest in Alameda, Los 
Angeles, and Tulare and smallest in Riverside and San Diego. GAIN'S effects on the amount of basic 
education received were greater for the more disadvantaged segments of the caseload: those with lower 
initial literacy levels and longer AFDC histories. 

• GAIN produced statistically significant impacts on the receipt of a GED or 
a high school diploma in four of the five counties. Tulare produced 
particularly large impacts, and the results in Alameda were also substantial. 
Impacts in the other counties were modest or small. 

Taole 2 shows the proportion of AFDC-FG experimentals and controls who received a GED or 
a high school diploma after random assignment. Across the five counties in the survey, 9 percent of 
experimentals obtained one these credentials during the follow-up period compared to 2 percent of 
controls, for a difference (i.e., impact) produced by GAIN of 7 percentage points. Tulare achieved a 
striking impact: a 19 percentage point difference between experimentals and controls. This was followed 
by an 8 percentage point impact for Alameda and a 4 percentage point impact in San Diego. The impacts 
in the other counties were snmller. In all five counties, individuals generally acquired a GED rather than 
a high school diploma. 

The varying impacts reflect differences in the counties' programs. The programs in Alameda 



^The survey estimates of participation rates for experimentals and controls were adjusted slightly upward, based 
on data from GAIN casefiles, to reflect underreporting of education activities on the survey. 

^^About one-quarter of the AFDC-FG survey respondent sample already had a GED or a high school diploma 
before random assignment. 

^^The variation in impacts on receipt of a GED or a high school diploma across counties was statistically 
significant at the .01 level. 
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TABLE 2 

FOR AFDC--FGS DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON PARTICIPATION IN ABE/GED AND ON CREDENTIAL RECEIPT. 
WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD 



Sample 



Outcome and Subgroup Size 



Ever participated 
in ABE/GED 

All counties 2,258 
County 

Alameda 466 

Los Angeles 389 

Riverside 582 

San Diego 380 

Tulare 441 



Received a GED or 
high school diploma 
after GAIN orientation 



Experimental Controls 

(%) (%) Difference 



43.6 8.4 35.3 (a) 

64.7 12.4 52.3 (a) 

33.8 6.5 27.3 (a) 

30.5 5.9 24.6 (a) 

33.6 6.5 27.2 (a) 
55.6 lOT 44.9 (a) 



All counties 2,258 
County 

Alameda 466 

Los Angeles 389 

Riverside 582 

San Diego 380 

Tulare 441 

Baseline score on CASAS 

reading and math tests 

21 5 or above on both 505 

214 or below on one 966 

214 or below on both 326 

No scores 461 



9.1 2.0 7.1 *** 

8.9 1.2 7.7*** 

2.7 0.5 2.2 * 

6.2 3.6 2.6 

6.8 2.6 4.2 * 
20.8 1.8 19.0*** 



25.2 5.4 19.7 *** 

6.3 1.2 5.1 *** 

1.5 0.0 1.5 

1.0 0.5 0.5 



Sample size (total = 2.258) i,207 1.051 

SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Calculations for this table used data for all survey responders. including those who did not 
participate in basic education. 

The "all county^ estimate is the average of the county estimates, with each county weighted 

equally. 

Sample members are missing CASAS test scores prinrwirily because they are not proficient in 

English. 

A two-tailed t-test was applied to differences between the experimental and control groups. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent, 
(a) Statistical tests were not performed for this nf>easure. 
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and Tulare are notable for their emphasis on assigning registrants to basic education programs. Both 
counties also placed a high priority on the acquisition of a GED (even for students in ABE programs), 
and almost half of Tulare's GAIN participants attended a GED program. Tulare's exceptionally large 
impact, which could not be explained by differences in the demographic characteristics of its sample 
compared to the samples for the other counties, may also be attributable in part to its counseling services, 
its close monitoring of participants, and the particular education services offered by its providers. 

• Impacts on receipt of a GED or a high school diploma were concentrated 
among those at higher initial literacy levels. 

Table 2 shows the rate of credential receipt for sample members who VrC'-e at different literacy 
levels at the time of random assignment. Those with a score of 215 or higher on both the reading and 
mathematics CASAS tests when they entered the research sample had a 20 percentage point impact on 
receipt of a GED or a high school diploma, whereas those who scored below this level on either test had 
a 5 percentage point impact. Sample members scoring below 215 on both CASAS tests and those having 
no CASAS test results (primarily because they could not read English) had no impacts on credential 
receipt. However, Tulare, in contrast to the other counties, produced substantial GED impacts for the 
large group that scored below 215 on one of the CASAS tests as well as very large impacts on the group 
that scored 215 or above on both tests. Interestingly, those at higher literacy levels spent less time in 
basic education than did those at lower literacy levels. Thus, impacts on educational attainment were 
achieved, for the most part, by the group with the smaller investment in education. 

Those with higher initial literacy skills may have had (or were close to having) the academic skills 
needed to master the material for the GED test, despite having dropped out of school. For them, the 
GAIN program may have provided an accessible route for acquiring the specific knowledge they needed 
to pass the test. The program may have also provided the necessary support services (such as child care), 
moral support, or "push" these individuals needed to pass the GED test. Those at lower initial literacy 
levels were more likely to participate in ABE programs and generally did not make the transition to GED 
programs (except, to some extent, in Tulare and Alameda). There were several possible reasons for this: 
Obtaining a GED may not have been the GAIN program's educational goal for them (consistent with the 
GAIN regulations, some counties encouraged participation in job search after completion of ABE); or 
they may not have reached satisfactory basic skills levels in the program; or they may have left the 
program before they made sufficient gains to enter a GED program. 

These findings suggest that the nature of the caseload served may affect the ability of a program 
to obtain GED impacts. For example, Los Angeles served a population with a relatively high proportion 
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of non-English speakers and individuals at low literacy levels. While its program had positive effects for 
those at higher literacy levels, this county served comparatively fev/ such individuals. For many 
registrants in Los Angeles, GED preparation may not have been encouraged by the program, or obtaining 
a GED may take longer than the follow-up period. 

• For the five counties as a group, GAIN did not produce impacts on basic 
skills levels, as measured by the TALS literacy test. Estimates show positive 
impacts on basic skills levels in San Diego, however. 

To measure GAIN'S impacts on educational achievement, two parts of the TALS, measuring 
somewhat different literacy skills, were administered to experimentals and controls who were determined 
to need basic education (including those who did not actually participate in basic education) two to three 
years after random assignment. (As noted above, those who were not proficient in English were not 
included in the testing.) The "document literacy" part of the test is designed to measure the ability to 
process information found in documents such as Sviiedules, tables, and charts. For example, one item 
requires the test-taker to locate a building using a map and its legend. The "quantitative literacy" part 
of the test is designed to measure the ability to understand written materials and to apply the appropriate 
arithmetic operations to solve problems presented in those materials. For example, one item asks the test- 
taker to calculate a daily wage using a want ad that lists an hourly wage. 

As discussed above, the size of the TALS sample was planned to be large enough to measure the 
achievement impact for all five counties as a group. The top row of Table 3 shows average TALS scores 
(document plus quantitative) for AFDC-FG experimentals and controls in all counties. Any difference 
between these averages is attributable to the GAIN program. However, the results show a difference of 
1.8 points, implying that there was virtually no program impact on basic skills levels for all counties as 
a group. 

The TALS sample was not expected to be large enough to give precise estimates of impacts for 
each county separately or for each subgroup. Estimates for counties and subgroups may, however, 
indicate the direction and approximate order of magnitude of their impacts. For San Diego, Table 3 
shows a TALS score difference of 34 points, or 36 percent of a standard deviation. This indicates that 
the San Diego GAIN progrun had a large TALS score impact. However, the exact size of the impact 
remains uncertain because the San Diego sample was small (60 experimentals and 54 controls). In 
Riverside, the experimental-control difference was negative and statistically significant. This negative 
estimate may not fully reflect a real program effect but may, instead, have been magnified by an 
experimental-control difference in the percentage of each research group that took the TALS test and 
could therefore be included in the TALS analysis sample. A difference in test-taking between research 
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TABLE 3 



FOR AFDC-FGs DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON TALS SCORES. WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD 



TALS Score 
(Document Plus Quantitative) 



Subgroup 


Sample 
Size 


Experimental 


Controls 


Difference 


Difference/ 
Standard 
Deviation 


All counties 


1.115 


475 


473 


1.8 


1 .9% 


County 








X 




Alameda 


334 


482 


480 


2.3 


2.5% 


Los Angeles 


186 


449 


445 


3.7 


3,9% 


Riverside 


233 


488 


507 


-19.0 * (a) 


-20.0% 


San Diego 


114 


488 


454 


33.8 ** 


35.6% 


Tulare 


248 


468 


478 


-10.2 


-10.8% 


Baseline score on CASAS 












reading and math tests 








XXX 




215 or above on both 


308 


544 


526 


17.8 * 


18.7% 


214 or below on one 


549 


478 


476 


2,2 


2.3% 


214 or below on both 


224 


388 


406 


-17,1 


-18.0% 


Sample size (total = i ,i 1 5) 




595 


520 







SOURCE: MDRC calculations using GAIN TALS data, 

NOTES: Calculations for this table used data for all TALS test responders, including those who did not participate 
in basic education. 

Estimates are regression -adjusted using ordinary least squares, controlling for pre-random 
assignment characteristics of sample members. Rounding may cause slight discrepanlces in calculating sums and 
differences. 

The "all county" estimate is from a regression in which each county is weighted equally. 

Sample sizes for the CASAS subgroups do not sum to the total sample size because a small proportion 
of individuals are missing CASAS scores, primarily because they were not proficient in English and could not take 
the CASAS tests. Thus, impacts for these individuals are not shown; the full distribution of impacts is given in 
Chapter 5. 

A two-tailed t-test was applied to differences between the experimental and control groups. Statistical 
significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

An F test was applied to subgroup differences in "difference" estimates. Statistical significance levels 
are indicated as xxx = 1 percent; xx = 5 percent; x = 10 percent. 

(a) The negative estimate in Riverside may have been affected by differences in the percentage of 
experimentals and controls who took the TALS and who therefore could be included in the TALS impact sample. 
Such differences in test-taking were statistically significant only in Riverside. 
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groups was large and statistically significant only in Riverside. The difference may have created 
unmeasured differences in the characteristics of experimentals and controls in the TALS sample in that 
county. The all-county estimate of the TALS score impacts excluding Riverside (not shown in the 
table) is 6.9 points, not statistically significant. 

Table 3 also shows that TALS score impacts accrued mainly to sample members who had scored 
highest on the CASAS tests (which were administered at the time of random assignment), and this group 
took less than the average time in basic education to achieve these basic skills gains (not shown in the 
table). In contrast, the group that started out at relatively low literacy levels did not achieve TALS score 
impacts, even though this group spent more time in basic education. This same concentration of TALS 
impacts among subgroups with higher initial literacy levels, found in the pooled sample across all 
counties, was also found in San Diego alone. 

Although the data available for this study do not explain why those starting at lower literacy levels 
did not experience achievement gains, several possible explanations are worth considering: The 
educational gains for this group may not have been large enough to be measured by this analysis; this 
group may not have received a sufficient amount of education to improve substantially their skills levels; 
or the education services provided may not have been effective in producing gains for this group. It 
could also be that the sample members achieved gains that were not measured by the TALS test. 

Some caution should be used when interpreting these impact estimates. Overall, the sample for 
the all-county average was large enough to rule out the possibility of generally large TALS score impacts 
per experimental; however, it was not large enough to rule out the possibility of modest impacts on 
tdMCdXion participants , In other words, while achievement gains could have been made by those who 
participated in basic education, they may have been too small or made by too few to appear in the 
experimental-control comparison. In addition, the fact that some counties increased GED receipt without 
producing measurable incisases in basic skills levels (or vice versa) indicates the importance of 
distinguishing between educational attainment and achievement goals, since each can be realized 
independently of the other. 

• Over a two-year follow-up period, the education impacts did not translate 
into welfare and employment impacts. However, the results for an early- 



^^An experimental-control difference in the percentage of TALS test-takers does not necessarily imply that 
impact estimates will be biased. Moreover, usmg the characteristics of sample members in the regression 
adjustment procedure can correct for observed research group differences. Baseline CASAS scores, in particular, 
provided a powerful set of regression control variables in the TALS impact analysis. 
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enrolling sample suggest the importance of further follow-up to determine the 
payofl* of GAIN'S investment in basic education* 

In the counties that produced impacts on educational achievement or attainment (Alameda, San 
Diego, and Tulare), the GAIN program did not result in earnings and employment impacts, for those 
determined to need basic education, within the two-year follow-up period that is available for the full 
sample at this time. For AFDC-FG sample members determined to need basic education, only two of 
the six counties studied in the evaluation of GAIN'S earnings, employment, and welfare impacts - Butte 
and Riverside - produced statistically significant earnings impacts within a two-year period, although 
most of the six counties were successful in achieving welfare savings for this group. Riverside's 
GAIN program, which uses both job search and basic education services and has a strong focus on quick 
employment, had a more immediate effect on employment and earnings, but little effect on education 
outcomes. Data on education outcomes were not collected in Butte, which was not part of the survey 
effort. 

Results for a small group of individuals who became part of the research sample early on, and for 
v/hom three years of follow-up data are available, suggest, however, that the two-year impacts may not 
be indicative of the longer-term effects of basic education in GAIN. In Alameda, Los Angeles, and 
Tulare, the early sample shows a possible growth in earnings impacts beginning just after the second year 
of follow-up and increasing into the third. Thus, longer follow-up is needed to determine whether the 
investment in basic education will pay off in the labor market.^"* 

Policy Implications 

This report presents results regarding the feasibility and effects of mandatory basic education 
provided through a JOBS program. (These findings do not apply to basic education provided in a 
voluntary context.) The results provide concrete evidence that such a program can increase the number 
of AFDC recipients who obtain a GED (or, in some cases, a high school diploma). It is possible for such 
increases to be large. However, the considerable county variation — ranging from very large impacts 



^^GAIN's two-year earnings, employment, and welfare impacts are presented in detail in Friedlander, Riccio, 
and Freedman, 1993. 

^'^Preliminary estimates of third-year impacts for AFDC-FG sample members judged in need of basic education 
indicate statistically significant earnings gains appearing for the first time in Tulare, increasing earnings gains in 
Alameda (not statistically significant), and continuing earnings gains in San Diego (not statistically significant). 
These estimates were produced from data that became available after the completion of the research presented in 
this report. Further data collection and additional analysis of longer-term impacts on earnings and AFDC payments 
are planned for 1994. 
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in Tulare to no impacts in some other counties - suggests that aggressive efforts need to be made if this 
goal is to be attained. The GAIN program in Tulare placed a high priority on maintaining participation 
in basic education and on obtaining a GED, carried out intensive monitoring, and provided support while 
students were in school. 

It is more difficult to ansv/er definitively the question of whether, and to what extent, the GAIN 
program can increase educational achievement ~ i.e., literacy and mathematics skills. The size of the 
TALS sample was sufficient for measuring relatively large achievement gains, but small gains may have 
escaped detection. Despite this limitation, the results from San Diego suggest that it may be possible to 
tailor basic education services to the special needs and circumstances of AFDC recipients and to produce 
sizable impacts on educational achievement. However, producing these results may require 
comprehensive adaptations to the program structure and curricula. San Diego's approach merits further 
study, although widespread replication on the basis of empirical results from one sample of this size 
would not be warranted. 

Overall, the findings point to at least three areas that merit the attention of policymakers and 
program operators. 

Adapting education services for welfare recipients. The experience in San Diego, and to some 
extent in Tulare, suggests that adult education programs may require special adaptations when they are 
part of a mandatory, large-scale welfare-to-work program such as GAIN. First, if educational 
improvements are sought, then it is important to make the improvement of specific education outcomes 
- GED receipt and/or achievement gains - a high priority of the program. Both San Diego and Tulare 
focused on specific outcomes and adopted numerous strategies to attain them. Second, to foster regular 
attendance, it may be necessary to provide substantial counseling, monitoring, and support services for 
students, as both San Diego and Tulare systematically did. Third, at least for those individuals at 
relatively high levels of literacy when they entered the program, the San Diego experience suggests the 
value of providing basic education courses that are intensive (i.e., classes meet many hours a week) if 
students' attendance is also carefully monitored and supported. Fourth, the results suggest the importance 
of adapting the curriculum to the needs of GAIN students, many of whom have had negative experiences 
in school. In San Diego, this v/as done by hiring a specially selected teaching staff, integrating academic 
and life skills, and using up-to-date computerized instruction combined with classroom instruction. 
Finally, obtaining a high completion rate for basic education activities may be crucial, requiring well- 
defined completion standards. 

Encouraging JED acquisition for those at higher literacy levels. This study provides evidence 
that GED certificates may be obtained relatively quickly for many program registrants who are already 
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at or near the literacy levels needed to master the specific knowledge required to pass the test. While 
the utility of the GED in the labor market needs further study, assigning people with higher literacy levels 
to GED instruction may yield substantial short-term education impacts. 

Providing effective services for those at lower literacy levels. This study raises questions about 
how existing adult education programs, which normally serve a voluntary population, can be structured 
or adapted to produce educational gains for the less-skilled segments of the welfare population. 
Individuals with lower levels of basic skills stayed in basic education programs for relatively long periods 
of time, and those programs provided them with an "opportunity to learn," as judged by conventional 
standards. Although the analysis was limited in its ability to measure modest achievement gains for this 
group, the results do indicate that any education impacts GAIN had for them were not large. This may 
mean that the amount and type of education services received were not effective for those at low literacy 
levels, particularly given the inconsistent attendance patterns observed in this study. Different and 
perhaps more comprehensive services may be needed to produce results for this group. 

The final report on the GAIN evaluation will measure the program's impacts over a longer follow- 
up period, providing further information on the relationship between basic education services and labor 
market outcomes. It will also explore new data on a number of outcomes (e.g., the characteristics of jobs 
obtained) and provide estimates of the program's benefits and costs. 



CHAPTER 1 
INTRODUCTION 



This is the seventh in a series of reports on the effects of California's Greater Avenues for 
Independence (GAIN) Program, which the Manpower Demonstration Research Corporation (MDRC) is 
evaluating under contract to the California Department of Social Services (CDSS).' GAIN, which began 
operations in 1986, aims to increase employment and foster self-sufficiency among people receiving Aid 
to Families with Dependent Children (AFDC), the major federal/state cash welfare program. Operating 
in all 58 California counties, GAIN is one of the most ambitious welfare- to- work initiatives in the United 
States. 

In July 1989, the GAIN program, with a few modirlcations, became California's version of the 
national Job Opportunities and Basic Skills Training (JOBS) Program. In accordance with the JOBS 
legislation (the Family Support Act of 1988), GAIN*s mandate was broadened to include single parents 
of preschool-age children ages three to five (in addition to those who had children above age five) and, 
in some cases, the second parent in two-parent families.^ 

Among GAIN'S chief innovations is its emphasis on mandatory, upfront basic education services. 
Welfare recipients who are determined to need basic education because they are lacking in basic skills 
(as determined by a literacy test), do not have a high school diploma or a General Educational 
Development (GED) certificate, or are not proficient in English are required to attend a basic education 
program or else be subject to a reduction in their welfare grant. These individuals may choose instead 
to participate in job search activities, but if they do not find a job, they must then attend basic education 
classes. The GAIN model is based on the belief that many welfare recipients will be able to function 
more effectively in the labor market if their basic skills levels are increased or if they obtain an education 
credential. GAIN allocates substantial resources to providing basic education to registrants who have 



'MDRC's previous reports on GAIN are: John Wallace and David Long, GAIN: Planning and Early 
Implementation (New York: MDRC, 1987); James Riccio, Barbara Goldman, Gayle Hamilton, Karin Martinson, 
and Alan Orenstein, GAIN: Early Implementation Experiences and Lessons (New York: MDRC, 1989); Karin 
Martinson and James Riccio, GAIN: Child Care in a Welfare Employment Initiative (New York: MDRC, 1989); 
Stephen Freedman and James Riccio, GAIN: Participation Patterns in Four Counties (New York: MDRC, 1991); 
James Riccio and Daniel Friedlander, GAIN: Program Strategies, Participation Patterns, and First-Year Impacts 
in Six Counties (New York: MDRC, 1992); and Daniel Friedlander, James Riccio, and Stephen Freedman, GAIN: 
Two-Year Impacts in Six Counties (New York: MDRC, 1993). 

^Single parents are in the AFDC-FG (Family Group) program; two-parent families arc in the AFDC-U 
(Unemployed Parent) program. 



been judged to need it, and this service plays a far larger and more important role than it has in previous 
welfare-to-work programs. 

Recent MDRC reports on GAIN have examined its implementation practices, participation 
patterns, and welfare and employment impacts for different types of welfare recipients served by the 
program. This report focuses exclusively on GAIN'S effects on one group of welfare recipients - those 
who were determined to need basic education (both single parents and heads of two-parent families) and 
were therefore ^.argeted for the mandatory, upfront basic education component. It draws on previously 
completed analyses as well as new data based on a survey of a sample of these recipients and the results 
of a literacy test, both of which were administered to them two to three years after they attended a GAIN 
orientation session and became part of the study. The report examines these individuals' experiences in 
basic education and the resulting education outcomes. Specifically, the study examines the proportion 
of welfare recipients who actually attended basic education programs, reporting on how much education 
they received, which groups received the most intensive education services, and what effect GAIN had 
on GED receipt (or, in some cases, receipt of a high school diploma) and on basic skills levels, as 
measured by the scores on the literacy test. This report also has important implications for the JOBS 
program, which offered states new incentives for providing basic education and expanded its role in their 
wel fare-to- work programs.^ 

The remainder of this chapter discusses the policy significance of GAIN'S mandating basic 
education services, briefly describes the GAIN program model, presents relevant findings from previous 
MDRC reports on GAIN, and provides an overview of the issues addressed in this study. 

L The Policy Context 

At the time the GAIN program was implemented, it represented a different approach to welfare 
reform - one that emphasized the provision of basic education services in addition to the job search and, 
to a lesser extent, unpaid work experience components that were the focus of most welfare employment 
programs in the 1980s. While the earlier programs increased earnings and reduced welfare receipt 
somewhat, and did so cost-effectively, research indicates that they did not move substantial numbers of 
individuals off the welfare rolls and that those who did leave often remained poor.'* These studies also 



^In most other JOBS programs, however, welfare recipients have more choice as to their initial activity, and 
basic education is a voluntary option. 
^Gueron and Pauly, 1991. 
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suggest that programs consisting primarily of job search assistance often were not able to increase tht 
earnings of the most disadvantaged. 

The structure of the GAIN program reflects in part the belief that improving these results must 
begin with the recognition that welfare recipients lack the basic skills or credentials to participate 
effectively in the labor market. Indeed, studies clearly show that welfare recipients often have poor basic 
skills and that education is strongly correlated with income.^ The GAIN model ~ particularly because 
of its upfront mandatory basic education component but also through its provision of skills training and 
post-secondary education - offers more opportunity for human capital investment than did typical 
welfare-to-work programs of the past. Although, in the short run, participants would be forgoing 
opportunities to work and "investing" in education in the anticipation of ftiture returns, policymakers 
reasoned that this type of model would be more effective in reducing poverty in the long run, as outlined 
in Figure 1.1. 

As the diagram illustrates, the mandatory nature of basic education, in GAIN is expected to 
produce increased levels of participation in basic education services as well as in other types of 
employment-related services (particularly job search). The quality of the education provided and the 
amount and intensity of the education and other services received are expected to determine the extent 
to which this intervention will be successftil in increasing welfare recipients' basic skills levels (i.e., their 
educational "achievement") and acquisition of a GED, high school diploma, or other credential (i.e., their 
educational "attainment"). If few recipients participate, if services are of low quality, or if insignificant 
amounts of education are received, the program could not be expected to affect education outcomes.^ 

Increases in achievement and attainment, in turn, are expected to lead to increased employment 
and earnings, employment in higher-quality jobs, decreased welfare receipt, and, potentially, the 
improved well-being of recipients' children (through higher family income or the improved education 
levels of their parents). Although more expensive in the short run, this type of model aims to expand 
the employment opportunities available to welfare recipients and decrease the rate at which former 
recipients return to the rolls. By reducing recidivism, the approach would decrease the cost of welfare 
in the long run. 



^Mincer, 1989; Berlin and Sum, 1988; Kirsch et al., 1993. 

*There can be low levels of participation and inadequate amounts of education services for a number of reasons 
ranging from an insufficient supply of services in the community to the resistance of some registrants toward 
returning to school. 
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FIGURE 1.1 



HYPOTHESIZED EFFECTS OF GAIN 
FOR THOSE DETERMINED TO NEED BASIC EDUCATION 



Welfare Recipients Are Required 
to Enroll in GAIN Program 



GAIN'S Mandate Results in Participation in Basic 
Education Services and Other Employment-Related 
Services 

• Quality Services Are Received 

• Sufficient Amount of Education Is Received 



Participation in Education Programs Produces 
Increased Educational Attainment and Achievement 

• Receipt of GEDs and High School Diplomas 
Increases 

• Basic Skills Levels Improve 



1 



Educational Attainment and Achievement Result in 
Increased Success In Labor Market 

• Employment and Earnings Increase 

• Quality of Jobs Obtained Improves 

(Wage Rate and Growth, Type of Job, Hours 
Worked, Job Stability and Satisfaction) 

• Welfare Receipt Decreases 

Well-being of Welfare Recipients' Children Improves 



When interpreting the effects of the GAIN program, it should be stressed that basic education is 
not the only service offered by GAIN to those determined to need it. As noted above, recipients can 
choose to participate in job search instead, although if they do not find a job, they are required to 
participate in basic education. Also, as described later in this chapter, GAIN offers support services, case 
management, and an assessment to determine subsequent activities including training, work experience, 
or additional education. Moreover, as discussed in this report, the welfare system in California is 
administered by individual counties, which differ in the degree to which they emphasize the two upfront 
options (job search and basic education) and the manner in which they present these options to recipients. 

Previous studies provide little evidence as to the effectiveness of large-scale welfare-to-work 
programs that emphasize participation in basic education in increasing the educational achievement and 
attainment and income of welfare recipients.'' Nor is much known about the feasibility of operating this 
type of program - particularly, how many individuals will participate in basic education services; how 
much and what kind of education they require and how much th^y will receive; whether the school 
systems can meet the needs of this mandatory population, in terms of both classroom space availability 
and the nature of the education provided; and whether improvements in basic skills will be sufficient to 
translate into increased employment and earnings. 

These are particularly difficult questions to answer. Little is known about the effectiveness of 
existing basic education services in assisting the general adult population in need of basic education (not 
just welfare recipients) to achieve long-term economic independence. Moreover, virtually all human 
capital studies have been based on data for individuals who voluntarily decide to acquire additional 
education. In contrast, the GAIN population is under a mandate to attend an education program. Many 
members of this group will have had previous negative experiences in school, including school failure 
and dropping out, and some may be reluctant to return to school. They also may lack the motivation, 
confidence, and school-relevant skills possessed by those who volunteer for education services. Thus, it 
is difficult to know a priori whether and how the GAIN model will produce its intended outcomes. 



^The evaluation of the Minority Female Single Parent (MFSP) Demonstration, which studied low-income 
minority single mothers, found earnings gains within a one-year follow-up period for a program integrating job- 
specific skills training with basic education services. Other programs in the demonstration, which required 
participants to take basic education courses before entering job-skills training, did not achieve similar early gains. 
(See Burghardt and Gordon, 1990.) While these results are important, it should be noted that MFSP was a 
voluntary program run by community-based organizations. GAIN, which is a mandatory, county-operated program, 
could produce different results. 
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II. The GAIN Model 



The GAIN model begins at the county welfare department's Income Maintenance (IM) office. 
(Figure 1.2 illustrates the basic sequences in simplified form.) Here, when determining initial or 
continuing eligibility for AFDC, the staff register GAIN-mandatory AFDC applicants and recipients for 
GAIN and offer to register recipients who are GAIN-exempt but might wish to volunteer for the program. 
As indicated above, the pre-JOBS rules defining mandatoriness for GAIN exempted single parents with 
children under the age of six, a group that accounts for about two-thirds of all single-parer ' AFDC 
recipients. No such exemption existed for the heads of two-parent families. 

After registration, eligibility workers refer new registrants to the GAIN office for orientation and 
appraisal. At orientation, the opportunities and obligations of the program are explained, and the 
registrant takes basic reading and mathematics tests developed by the Comprehensive Adult Student 
Assessment System (CASAS) organization.* As part of the appraisal interview, the assigned case 
manager reviews the registrant's background characteristics, including circumstances that might prevent 
her or him from participating in GAIN, and determines a preliminary employment goal. The registrant 
is then either referred to a GAIN activity or "deferred" (i.e., temporarily excused from participating). 
GAIN'S support services, such as child care and transportation, are arranged at this time if the registrant 
needs them to take advantage of the program's activities.' Participation in GAIN is expected to continue 
until the individual finds employment, leaves AFDC, or is no longer required to participate for other 
reasons. Failure to comply with program rules can result in a "sanction" (i.e., a reduction or termination 
of the monthly welfare grant).'" 

As noted above, not all those who attend an orientation are expected to take part in a GAIN 
activity. GAIN'S regulations permit temporary deferral from the participation requirement for those who 
have a part-time job, temporary illness, family emergency, or another situation that, according to the 
GAIN legislation, precludes attending an activity. Welfare recipients are also not required to remain 



'CASAS is a nonprofit organization based in San Diego. 

'GAIN helps registrants find, and pays for, child care services for children who are under the age of 13 - 
assistance that continues for a one-year transitional period if the registrant leaves welfare for employment. GAIN 
also reimburses program participants for relevant public transportation costs (unless a car is essential) including 
transportation for their children to and from a child care facility. Participants may also receive up to $450 for 
program-related expenses such as tools and books. Finally, GAIN funds can be used to identify the need for 
counseling for personal or family problems that arise from or hinder participation in the program or employmem 
and to make an appropriate refen-al. For details on GAIN'S support services, see Riccio et al., 1989. 

"Prior to JOBS, registrants who were heads of two-parent families lost their entire grant if they were 
sanctioned, whereas single parents lost only the parent's (not the children's) portion of the grant. Under JOBS, the 
heads of two-parent families who are sanctioned similarly lose only the parent's share of the grant. 
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registered for GAIN if they meet certain exemption criteria such as getting a full-time job (of at least 30 
hours per week) that does not pay enough to make a person ineligible for AFDC or being chronically ill. 
These individuals are "deregistered ' (i.e., officially removed) from the program, as are those who leave 
AFDC entirely for employment or other reasons. Still others who are expected to participate but choose 
not to may be sanctioned. 

As shown in Figure 1.2, GAIN has two primary service tracks. Registrants who lack a high 
school diploma or a GED, score below 215 on either the reading or mathematics CASAS basic skills 
test," or are not proficient in English are determined by GAIN regulations to be "in need of basic 
education. " 

Depending on their skills levels, individuals will potentially enroll in one of three kinds of ^.asic 
education programs: (1) GED preparation programs, which are designed for students whose academic 
levels are high enough to enable them to study productively for the GED test; (2) Adult Basic Education 
(ABE) programs, which provide remedial reading and mathematics for those whose skills levels are lower 
(typically, at or below the eighth-grade level); or (3) English as a Second Language (ESL) programs, 
which provide basic reading and language instruction to individuals who are not proficient in English. 
As noted above, registrants on this track may elect job search assistance instead, but if they do not find 
a job, they must then enroll in a basic education class. Alternatively, they may choose to participate first 
in basic education and then in job search, or they may elect to pursue job search and basic education 
concurrently. 

The second track is for registrants who are determined "not in need of basic education" (i.e., they 
have a high school diploma or a GED, pass both the reading and mathematics CASAS tests, and are 
deemed to be proficient in English). They are usually referred first to a job search activity. Job search 
activities include job club - group training sessions in which participants learn basic job-seeking and 
interviewing skills - and supervised job search, in which participants have access to telephone banks, 
job listings, employment counseling, and other assistance under staff supervision. Job search activities 
usually last for three weeks. 

A third track is available for r( sistrants who began an education or training activity prior to 
attending an orientation and appraisal (and irrespective of whether their appraisal detennined them to need 



A score lower than 215 on the reading or mathematics test is a criterion used by the GAIN program to 
determine that individuals are in need of basic education. According to CASAS, those who function below 215 are 
at low literacy levels and have difficulty pursuing programs or jobs other than those that require only minimal 
literacy skills. Those at or above the 215 level are able to handle basic literacy and computational tasks 
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basic education). At the appraisal session, the registrant's case manager decides whether the activity 
ftirthers the registrant's employment goal. If the decision is positive, the case manager may authorize 
the registrant to continue attending the program as a GAIN activity and to be eligible (for no more than 
two years) for GAIN'S support services. Such an activity is referred to in GAIN as "self-initiated" 
education or training. 

Registrants who complete their upfront activities without having found a job must participate in 
a formal assessment of their career plans and work out an individual employment plan. They are then 
referred to "post-assessment" activities intended to further their employment plan. Possible activities 
include vocational or on-the-job training, unpaid work experience (or "workfare," which in GAIN is 
referred to as PREP),^^ supported work,^^ or other forms of education and training. For some 
individuals, a 90-day job search follows the post-assessment activity; they seek work on their own and 
periodically report to GAIN staff. If this fails to lead to a job, registrants are assessed again and another 
activity is selected. 

In most of California's 58 counties, GAIN operates through a network of service providers in the 
community, with the welfare department at the center. Typically, the county welfare departments register 
people for GAIN, manage the overall program, provide case management, develop PREP positions 
(rarely used during the participation follow-up period covered by this report), and, in some cases, conduct 
job clubs and other job search activities. With a few exceptions, the rest of GAIN'S program functions 
and services are the responsibility of agencies outside the welfare department. For example, adult schools 
- and sometimes community colleges and other organizations - supply basic education services, often 
using state Job Training Partnership Act (JTPA) "8 percent funds" (i.e., funds set aside for education, 
a portion of which, in California, was earmarked specifically for GAIN participants). Community 
colleges, proprietary schools, regional occupational centers, and JTPA vendors typically provide 
vocational education and training. Also, in many counties, the local offices of the state's Employment 
Development Department (EDD) operate GAIN'S job club and other job search components. In addition, 



'^PREP (Pre-Employment Preparation) is unpaid work experience in a public or nonprofit agency in exchange 
for the recipient's welfare grant. PREP assignments can be short-term, lasting up to three months, or long-term, 
lasting up to one year. The number of hours of the work assignment are determined by adding the recipient's grant 
(less any child support the noncustodial parent has paid to the county) and the Food Stamp allotment, and dividing 
that sum by the statewide average hourly wage. PREP work assignments may not exceed 32 hours per week. 

'^Supported work is paid work experience, in a group setting, for participants with little work history. It is 
characterized by close on-site supervision, peer support, and gradually increased responsibilities. A closely 
associated activity is transitional employment, which provides less intensive supervised training in a work setting. 
Neither of these activities was used in the six research counties during the period covered by this report. 



most counties rely on local child care resource and referral agencies (although to different degrees) to 
help registrants find child care and often to make arrangements with child care providers. Frequently, 
the GAIN staff also take part in this process. 

in. Interim Impact Findings from the GAIN Evaluation 

The evaluation of GAIN'S effects (or impacts) uses an experimental research design and is based 
on a study of six counties: Alameda, Butte, Los Angeles, Riverside, San Diego, and Tulare. As 
illustrated in Table 1.1, the May 1993 report presented GAIN'S impacts on employment, earnings, and 
welfare receipt in these counties over a two-year follow-up period.*'* The analysis presented here does 
not include additional information about those impacts because further data are not yet available and the 
intent of this report is to focus on education-related outcomes. To provide context, however, the results 
from the May 1993 study are briefly summarized here. 

For the entire sample of single parents with children over the age of five (including parents in 
need and not in need of basic education), GAIN produced earnings gains and welfare savings through the 
second year of follow-up. The results varied considerably across the six counties studied, with one 
county (Riverside) having had unusually large two-year impacts and another county (Tulare) having had 
virtually no impacts. The other four counties also produced significant impacts in the first year, although 
not always on earnings and welfare payments. 

In contrast to the results for the entire sample, for single parents determined to need basic 
education, only two counties - Butte and Riverside - produced statistically significant earnings gains 
within a two-year period, although five counties achieved welfare savings for this subgroup. However, 
because basic education is a longer-term investment, the full extent of its contribution to impacts, if any, 
might not be seen until future years. As discussed in the May 1993 report and later in this report, some 
preliminary evidence, based on a small group of people determined to need basic education who became 
part of the research sample at an early stage of the study, suggests that earnings impacts may remain 
strong in Riverside for this subgroup in the third year of follow-up and may actually increase not only 
in Butte, but also in Alameda, Los Angeles, and Tulare as well. Hence, the counties' impacts for those 
in need of basic education may grow over time. This as well as other issues will be addressed in the final 
evaluation report, which is scheduled for 1994. 



'*See Friedlander, Riccio, and Freedmaii, 1993. 
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TABLE 1.1 

RESEARCH SAMPLES AND SELECTED TOPICS COVERED 
IN 1993/94 MDRC GAIN EVALUATION REPORTS 



May 1993 Report 

Report included all single parents (AFDC-FGs) with children above age five and all heads of two- 
parent families (AFDC-Us). 

Topics: 

• Participation patterns in all GAIN activities; program implementation strategies, 

• Two-year welfare and employment impacts; three-year impacts for early cohort. 

This Report 

Report includes single parents (AFDC-FGs) with children above age five and heads of two-parent 
families (AFDC-Us) who were determined to be in need of basic education according to GAIN 
criteria 

Topics: 

• Levels of participation in education, amount of education received, and 
description of education services provided. 

• Two- to three-year impacts on educational achievement and attainment. 

• Two-year welfare and employment impacts; three-year impacts for early cohort. 

Final Report (Spring 1994) 

Report will include all single parents (AFDC-FGs) with children above the age of five (and a 
small sample with children ages three to five) and all heads of two-parent families (AFDC-Us). 

Topics: 

• Three-year welfare and employment impacts; four-year impacts for early 
cohort. 

• Information on wage levels and types of jobs obtained. 

• Benefit-cost analysis. 
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IV. An Overview of This Report 



In sum, the aim of this report is to analyze the educational experiences of and outcomes for GAIN 
registrants who were determined to need basic education, and thereby to take an important step toward 
understanding the longer-term employment and welfare results for this group, which will be presented 
in the final report. Drawing on both the new data and the earlier analyses in the GAIN evaluation, this 
report examines the following questions: 

• To what extent did the GAIN program increase the participation of welfare 
recipients in basic education services above and beyond what they would have 
done on their own? The study examines the effect of GAIN on how extensively 
welfare recipients participated in basic education services by comparing their 
experiences with those of a control group that did not have access to GAIN'S 
services. The report also examines what factors limit the use of education 
services by GAIN registrants. 

• Did the education services offered through GAIN provide a reasonable 
opportunity for learning to take place? This is assessed by examining the 
features of the education programs, the types of activities the education services 
included, and service adaptations that were made for the GAIN population, 

• Kow much education did participants receive? This report goes beyond past 
reports' primary focus on rates of participation by measuring the amount of 
education received, particularly how long participants attended their basic 
education programs and how many hours of services they received within a two- 
to three-year period. It also provides information on what type of welfare 
recipients participated for the longest periods of time and the attendance patterns 
of basic education participants. 

• Was the GAIN program successful in increasing welfare recipients' basic 
skills levels and their receipt of education credentials? This study presents 
impact results for these education outcomes and also examines the type of welfare 
recipients for whom the GAIN program had the greatest effect in increasing basic 
skills levels and receipt of a GED (or a high school diploma). 

• In all of the above respects, were there noteworthy differences among the 
research counties? Previous MDRC reports on GAIN have revealed striking 
differences across counties, in terms of both program implementation and impacts. 
This report continues the exploration of differences in county programs and 
outcomes, and offers some hypotheses about what implementation approaches may 
yield stronger education impacts. 

A supplementary goal of this analysis is to assess whether, with respect to basic education, the 
GAIN model received a "fair test" - i.e., whether it was implemented in a manner that would be 
expected to produce the intended education outcomes. For example, if few welfare recipients were 



offered education services or if the services were of poor quality, there would be little reason to expect 
results. It is also important to determine whether an adequate amount of education was received and, if 
not, whether this was driven by programmatic issues (such as insufficient capacity) or welfare recipient 
issues (such as welfare turnover or resistance to participating in services).'^ 

It is important to understand some of the inherent limitations of this study. First, this report does 
not provide an evaluation of the basic education activities per se. Rather, it examines the effects of the 
GAIN program as a whole for those who were determined to need basic education. Also, it does not 
address the effects of basic education provided to those who volunteer for the service; rather, it studies 
the results of this service when provided through a mandatory welfare-to-work program. Finally, owing 
partly to the relatively short follow-up period, this report does not fully address the relationship between 
educational achievement and attainment and economic outcomes such as employment, earnings, and the 
characteristics of jobs obtained. This relationship will be discussed in the evaluation's final report.*^ 

This report consists of five chapters. Chapter 2 describes in detail the research design for the 
study, the data sources used in the analysis, and the demographic characteristics of the GAIN sample who 
were deemed in need of basic education. Chapter 3 documents the GAIN treatment for those determined 
to need basic education and describes the "opportunity to learn'* provided by the education programs 
offered through GAIN. It focuses on what happened to individuals who enrolled in GAIN (and thus 
reports only on results for the experimental group), including the extent to which they took advantage 
of the education services, how long and how intensively participants attended these activities, how this 
varied by subgroup, and the extent to which they completed the activities. These are important 
dimensions in assessing whether the GAIN model was given a fair test. 

Chapter 4 examines how much GAIN increased participation in services above and beyond what 
welfare recipients would have received in the absence of the program. This analysis consists of a 
comparison of experimental and control group members on several participation measures. If no 
differences were observed between these two groups, there would be no reason to expect this component 
to contribute to GAIN'S impacts on education or economic outcomes. Chapter 5 analyzes the GAIN 
program's impacts on educational attainment and educational achievement. 



'^If inadequate amounts of education were provided for programmatic reasons, that would suggest that the GAIN 
model was not given a fair test. However, if registrants resisted attending and did not participate for adequate 
periods even when the services were available, that would indicate that a fair test was provided but the model did 
not produce the intended results. y 

'^It is beyond the scope of the GAIN evaluation to address the effect of the program on the well-being of 
recipients* children. This issue will be studied directly in the national JOBS evaluation. 
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CHAPTER 2 

RESEARCH DESIGN. DATA SOURCES. AND SAMPLE CHARACTERISTirS 



This report focuses exclusively on one group of welfare recipients from the overall GAIN 
evaluation: those determined to need basic education. The GAIN evaluation's analysis of welfare and 
employment impacts to date is based on a research sample of approximately 33,000 individuals, from the 
six research counties, who were randomly assigned to the experimental or control group. Of this 
number, roughly 21 ,000 were determined to need basic education. To collect information on panicipation 
in basic education and receipt of a GEO or a high school diploma, MDRC surveyed a subset of 
approximately 2,500 of these 21,000 welfare recipients in five of the six counties (all but Butte) two to 
three years after random assignment. To measure educational achievement, a literacy test was 
administered at the time of the survey to about 1,100 of these 2,500 individuals. 

This chapter describes the research design for the GAIN evaluation as a whole and this report 
specifically. Sections I and II describe the counties included in the GAIN evaluation and the random 
assignment process that was implemented in them. Section III discusses data sources and the strategy that 
guided data collection. The final section. Section IV, describes the background characteristics of 
members of the study sample. 

!• The Resear ch Counties in the GAIN Evaluation ' 

The six counties in the study of GAIN'S impacts represent diverse geographical regions of the 
state, vary widely in local economic conditions and population characteristics, and constitute a mix of 
urban and rural areas. (See Figure 2. 1 and Table 2.1.) They include three large, mostly urban, southern 
counties (Los Angeles, Riverside, and San Diego); one county in the Central Valley, a rural region 
dominated by agriculture (Tulare); a moderate-sized county in the San Francisco Bay Area (Alameda, 
which includes the City of Oakland); and one small northern county (Butte). Two of the counties 
(Alameda and Los Angeles) include large inner-city neighborhoods, and most are home to sizable 
populations of recent Asian and Hispanic immigrants and refugees. As described below, because 
resources for survey and test administration were limited, Butte was not included in the registrant survey 
or literacy testing. 



'The material in this section is drawn from Friedlander, Riccio, and Freedman, 1993. 
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FIGURE 2.1 



MAP OF CALIFORNIA SHOWING THE SIX COUNTIES 
PARTICIPATING IN THE GAIN IMPACT RESEARCH 




CM 
UJ 

m 
< 



UJ 
Z 

o 
o 

X 

o 

< 

UJ 
(/) 
UJ 
GC 
Z 
< 

UJ 



LL 
O 
C/3 
U 

CO 

GC 
Ui 
K- 
O 
< 
GC 
< 
X 

o 
o 

UJ 

O 
UJ 

Ui 
CO 



2 

JO 
3 



o 

0) 



CO 



0) 

.2: 

QC 



CO 

J© 



CO 

O 



(0 

E 

(0 



GO 



GO 



GO 
GO 



00 



GO 



o 

00 



O) 
GO 



GO 
TO 



GO 
GO 



O 
CO 



o 



GO 

so 

CO 



o 



GO 



.S2 

0) 

1 

OS 

o 



E 

< i 

.£ 

03 

2 E 

1 1 

c (d 

05 



CO in O) 
o in in 



CO 



00 



ir- 0> <0 il> 

Tf CO in CD 



CNJ 



CO CO 
(6 (6 G> ^ 



p 

CO* 



Cp CNJ GO GO 
Tf in CD GO 



GO 

d 



0> CO 



p <^ GO CV 

GO r*<^ GO d 



CM 
CNJ 



00 <t- 
CD 



p 00 
CO <^ in 



1- CO 

d d 



OS 

a 



0) 

a. 



^ <J) O 1- CVJ 

O) O) 0 0 

a> a> o o 
^ c c c c 

C 13 13 13 13 

E 00 o> O ^ 
>tOO GO 0> 0> 
JD <7> <7> 0> 0> 
CX^ ^ ^ ^ 

E^x^x^x^ 

0) 13 13 13 13 
C "5 "5 "5 



I 2 E 

r- ^ Og «^ 

— CO 

© 3 O <0 

< 8 "5 to 



o 



CO 

OS 



o 

CO 

C =3 

1 2 

I ^ 
I 

§• ^ 

a UJ 



CO 



CO in 

CVJ CO 
y- CD^ 

in in 



CO K 
CNJ K 
00 

^"cnT 

CNJ 



CD O 

CD CO 
O CNJ 
CNJ 



CNJ 't- 
CO CO 
^ CNJ 



in o 

CD 
CNJ O 

nT co" 

CNJ 



CNJ 



in 

CO 



CO 
CO 



CO 

d 



O 



0) 

E 

0) 

o 
Q 
co" 

0) 
CO 
CO 

o 



o 

^ 4- -? 
566 

§ < < 
z 



1— in O) in 

in CM Tj- CM 
P CM p 

co" in 



CM CD c» 
CO CM GO 
0)_ ^ p CO 

in cd" 1-^ 

^ CM 



(D <J> ^ <J) 
GO GO in CM 

p CO rs._ 
in cm" 00" 



c» CO 



<i- CJi 
GO p 

co' co" 



www w 
c c c c 



in ^ in ^ 
CJ) m GO CO 
in CM CD in 

CNJ 



O 
C3> 



0) 

E 

0) 



3 

6 

Q 
Ll. 
< 

c 

CO 

O 

LL 



CO o 
c Q 

B CO 
£■8-2 ® 



5 



O O c — 



— Q Q o iS 
E Ll. u. X o 

- < <UJK 



T5 

3 



c 
o 
o 



ERIC 



■16- 



ID 



CO 
CD 
CO 



CO 
CO 



CO 



•55 



JO 



■eg 
o E 

0) o 
(/> o 

« LL o 

O Q 
.S S5 

5 c 
CL oQ 



if 

CO E o 
0 <o o 

« ^ U- 

I?? 

- o « 



o , 



CL £5^ 



(0 
(0 

> 



CO 
0) 

o 

o 
z 
< 



9 

E 

3 



o 8 

CO 



8 



o 

ol 

CO 



CO c 

oS 

CO 



rm 


nly 




o 




CO 


c 


c 


o 




—I 


recipi 



to c 

6 8 

CO 



© O 

c c 
o o 
-J*aJ 



a> 
E 
E 

T5 
(0 

O C 
(o *i5 

CO ' 
CO 



2? 
.E-D 

"S « 

>« o 
E 5 
© ft* 
c c» 

0) < 

o 

£1 O 

!8"g 



(0 



(0 



I" 

I- 

is 
^« 

Q S 



g CO 

E 9 

Q. 0> 

to 
a> c 
5: ® 



is 

>»o> 

Q. 

E _ 

(0 q> 

o o 



CO 



CO <0 
UJ £ 

O 3 

0) 3 



.2: 

12 
o 



li 

0 7: CO 

is CO 
S « <o 

lei 



.2 

•g « JO 

3 

O -C CO 5- 

x^§.^s < 

§ 0-00 
0O.C0 ^ 
o o -c o 

♦-.So© 



o 
c 

(0 

o 
£ 



lip 



If 
o 

pi 



CNJ 

co" 
00 



EE - 

J .2: 

o £^ 
o o E 

u. -Js © 
J' £ © 



-£ E « 

2 



• »- " ® 

M k. <0 V) 

£ E 9 
o ©£ E» 
•S 8 « o 

^ O © E 
«2<^ > w 

C O © (A 

.£-dCO 
Q. C . © 

© © © -tJ- 

© 



CO 
(0 

s 

CJ> 

© 

E 
© 

^ © 



© 

CO s © 

w C7> © 
£ 3 CO 

itTJ © 

(0 E JD 



(0 

S-^Q^^ ©I 
5:5 :£ © o « o 

i« S? 2 I » 



o 
£ 52 
O S 

< s 

£^ 
|o 

go 

c > 

•c •£ 
O g 



(0 
O. 

W Q 
UJU. 

Z CO 



© K _c .ii 

5 ® © .^iS 5 
^ « «2 © < © © 
O Z c 

-2 < CO -0 



© 

CO $ 

c © 
© ^ 

Q. W 

© © 

® £ 

© o> 

£J 

(0 © 

< © 

^ CO 

Q 



CO 



CO 



-17- 



Partly reflecting differences in their geography, GAIN funding levels, and the degree of dispersioi 
of their welfare populations, two of the counties (Alameda and Butte) operated their GAIN programs oui 
of a single location, while the others established several local GAIN offices (San Diego, with eight, had 
the most). The total GAIN caseload ranged from 2,531 in Alameda to 24,397 in San Diego at the end 
of December 1990 (which was six months following the completion of sample intake for the GAIN 
evaluation).^ 

Although the GAIN participants in these six counties were not strictly representative (in a pure 
statistical sense) of GAIN registrants in California as a whole, together they accounted for about one-third 
of the state's entire GAIN caseload in December 1990. (Over half of the entire slate AFDC caseload 
lived in these counties, with 34 percent of all cases having been located in Los Angeles alone.) Thus, 
while the results of the evaluation are not general izable to the state as a whole, they do provide a test of 
GAIN as implemented under a wide range of conditions found across California. 

All of the research counties began operating their GAIN program between January 1987 (Butte) 
and October 1988 (Los Angeles). (See Table 2.1.) During the period when the research sample was 
being collected (i.e., the "period of random assignment," which will be explained in Section II), Butte, 
Riverside, San Diego, and Tulare had the resources to operate a "universal" program, i.e., they registered 
all welfare applicants and recipients whose participation in GAIN was mandatory. (As noted in Chapter 
1, others who were exempt from the participation requirement were allowed to volunteer.) In contrast, 
Los Angeles and, in almost all cases, Alameda registered only long-term welfare recipients, in accordance 
with GAIN regulations, which require counties to give priority to those on aid for two or more years 
when funding constraints do not permit all eligible persons to be served. Los Angeles registered only 
welfare recipients who had received AFDC for at least three consecutive years. However, except for 
those who met the official exemption criteria, all recipients in this category were referred to GAIN. 
Alameda began by registering individuals who had been receiving AFDC since 1980, but subsequently 
registered more recent welfare recipients.-^ 



The average statewide GAIN caseload in July 1990-June 1991 was 178,676 cases per month. As a result of 
decreased funding, this average fell to 164,253 cases per month in July 1991-June 1992. In December 1990, 
approximately 27 percent of all AFDC cases statewide were registered for GAIN. By December 1992, this number 
had declined to approximately 18 percent (14 percent of all AFDC-FG cases and 35 percent of all AFDC-U cases). 
Funding for GAIN (not counting "community resources" such as the substantial amount of JTPA and California 
State Department of Education monies earmarked for serving GAIN students but not controlled by CDSS) was 
$215.5 million in state fiscal year 1990-1991. It fell to $192 million in 1991-1992, and was then increased to $212 5 
million in 1992-1993. 

^Prior to the start of the evaluation, Alameda gave priority to long-term recipients, within both the GAIN- 
exempt and non-exempt groups, who volunteered for the program. 
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As will become apparent, the different intake policies across the counties, along with differences 
in the general makeup of each county's local population, yielded research samples that varied markedly 
in their demographic composition. This is an important fact, which must be kept in mind when 
comparing the effects of GAIN across the six counties. 

Table 2.1 presents trends in unemployment rates in each county during the period of random 
assignment as well as through the end of the two- to three-year follow-up period for this report/ 
Overall, unemployment rates were generally increasing toward the end of this study period, a pattern 
influenced by the state and national economic recession. Nonetheless, Tulare consistently had the highest 
unemployment rates, with a monthly average of over 11 percent between July 1989 and June 1990 and 
an average of about 16 percent in the following two years. (A severe freeze in 1991, which destroyed 
much of the crop in that largely rural and agricultural area, contributed to this rise in unemployment 
rates.) Economic conditions also varied considerably across the other counties. Alameda and San Diego 
consistently had the lowest unemployment rates. 

A somewhat different picture of local economic conditions emerges when an alternative measure 
- the annual rate of change in the number of county residents employed - is considered. (See Table 
2.1.) Over the course of the random assignment and follow-up period. Riverside stands out as having 
had a higher growth rate than any of the other counties, especially early on, with an average increase of 
3 percent per year. This measure may be indicative of better opportunities for finding jobs. Butte 
followed, with a growth rate of 2.2 percent per year, and San Diego had a rate of 1.2 percent per year. 
Los Angeles experienced very little growth in the number of employed residents, while the rate was 
slightly negative for Alameda, and even more negative for Tulare. Although the county variation on this 
measure does not correspond well with the pattern of unemployment rates, the two measures together 
illustrate the more general point that the counties faced quite different local circumstances in operating 
their GAIN program, which must be taken into account when comparing county impacts. 

IL An Overview of the Research Design for the GAIN Evaluation 

To test the effectiveness of GAIN in increasing welfare recipients' employment and earnings and 
reducing their use of AFDC, a random assignment research design was instituted in each of the six 
counties. In addition, to determine the fuller set of impacts for the group determined to need basic 
education, the evaluation included this study of education impacts. All individuals who, during the period 



'^The employment statistics presented in Table 2.1 were obtained through June 1992, which covers the two- to 
three-year follow-up period for most sample members. 
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of sample intake, were designated at the Income Maintenance office as mandatory registrants for GAIN* 
and attended a program orientation and appraisal at the GAIN office were randomly assigned to either 
an experimental group, which was eligible to receive GAIN services and subject to the participation 
mandate, or to a control group, whose members were not eligible for those services - including GAIN'S 
child care services - and not subject to the mandate. (See Figure 2.2.) The members of the control 
group could, however, seek alternative services in the community on their own initiative. Later, both 
groups - which together make up the research sample for the study of GAIN'S impacts - were followed 
up. The differences in their employment, earnings, and welfare receipt (and, for a representative 
subsample of the "in need of basic education" group, education-related outcomes) represent the measured 
impacts - or effects - of GAIN. 

In some other studies of welfare-to-work programs, random assignment has taken place when 
people came into the Income Maintenance office, rather than later, at program orientation, as it did in 
the GAIN evaluation. Under the former type of design, the impact sample includes individuals who never 
show up at a program orientation as well as those who do show up, and thus fully represents the caseload 
of individuals referred to the program. When random assignment is placed later, at orientation, 
registrants who do not show up for the program - a potentially sizable group^ - are not part of the 
research sample. Thus, the results cannot be directly generalized to the entire caseload of registrants 
referred from the Income Maintenance office. This issue is important when comparing the results of the 
GAIN evaluation with those of other studies. 

Table 2.1 shows that the random assignment period for the GAIN impact study started and ended 
at different times in each of the six counties. (Random assignment concluded when the number of people 
required for the research had been enrolled in the sample.) Butte, the smallest of the six counties, 
conducted random assignment for about two years, from March 1988 to March 1990. The process was 
shorter in the other counties, ending everywhere no later than June 1990. Overall, about 55 percent of 
the research sample were registered prior to July 1989, the date of GAIN'S transition to JOBS. Random 



^As noted above, the mandatory population was broadened under JOBS, but only the groups considered 
mandatory for GAIN under the pre-JOBS rules ~ i.e., single parents whose youngest child was age six or older 
and the heads of two-parent families - are included in the analyses for this report. 

^Although the orientation "no-show" rate was not measured in the six counties discussed in this report, it was 
measured in seven of the eight counties included in MDRC's 1989 implementation report (Riccio et al., 1989. 
Chapter 4). In that sample, nearly one-third of all mandatory registrants did not show up for an orientation and 
appraisal within six months of their scheduled orientation. By the end of the six-month follow-up period, roughly 
two-thirds of those who did not attend an orientation had either left welfare or were officially excused from 
participating in the program. 
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FIGURE 2.2 



OVERVIEW OF THE INTAKE AND RANDOM ASSIGNMENT PROCESS 
FOR THE GAIN EVALUATION 
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assignment began in each county sometime between 7 and 14 months after the county began operating 
GAIN. 

III. Data Sources and Research Samples for This Report 

This report analyzes GAIN'S effects on GAIN-mandatory registrants, both single parents with 
school-age children (mostly mothers), referred to as AFDC-FG registrants, and the unemployed heads 
of two-parent families (mostly fathers), referred to as AFDC-U registrants.^ As discussed in Chapter 
1, and unlike the previous MDRC reports on GAIN, this report is concerned exclusively with AFDC-FG 
and AFDC-U registrants who were determined to need basic education. 

This section of the chapter discusses the data sources used in this analysis, the groups of 
registrants for whom each type of data was collected, and the time period covered by each data source. 

A. Data Sources 

As described in Chapter 1, this report addresses a wide variety of topics, including the operation 
of basic education programs for GAIN registrants, the amount of education received by GAIN basic 
education participants, and GAIN'S impact on participation, educational attainment, and educational 
achievement. A range of data sources was required to address these diverse topics. The major sources 
are discussed briefly below: 

• Baseline data. The state's client information form (or "GAIN-26") was used to 
collect demographic and identifying information about experimental and controls 
when they first entered the research sample. A few special categories were added 
to this form for research purposes. The CASAS reading and mathematics tests 
were also administered to most sample members (except those who were not 
proficient in English). The GAIN regulations required that these tests be 
administered as part of the program's intake process. The GAIN-26 and CASAS 
test data are used to describe the research sample, identify important subgroups, 
increase the precision of impact estimates, and analyze selection bias when 
subsamples are used. 

• AFDC and UI records data. Data on welfare payments and welfare receipt were 
obtained on all experimentals and controls from each county's computerized 
welfare payments records. Employment and earnings data came from the 
computerized California State Unemployment Insurance (UI) Earnings and 



''The total research sample also includes individuals who were nevyly mandatory for GAIN under the JOBS 
legislation (i.e., they had a child under the age of six). Although not included in the present analysis, GAIN'S 
effects on that group will be examined in the evaluation's final report. 
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Benefits Records. These data were used to analyze GAIN'S impacts on welfare 
receipt and employment, which are discussed only briefly in this report.^ 

• Registrant survey data. A survey was administered to a subset of experimentals 
a):d controls, either by phone or in-person two to three years after random 
assignment. Most registrants who completed the survey received a $25 payment. 
The survey examined registrants' self-reported participation in a range of activities 
and receipt of a GED or a high school diploma (other outcomes were also 
measured but are not discussed in this report). 

• Literacy test (TALS) data. In conjunction with the registrant survey, two parts 
of a literacy test were administered to a subset of experimentals and controls 
approximately two to three years after random assignment. Usually, the literacy 
test was administered in the registrant's home and during the same visit in which 
the survey was administered. Those who completed the survey and literacy test 
received a $35 payment. The test consisted of the document literacy and 
quantitative literacy parts of the Test of Applied Literacy Skills (TALS), 
developed by the Educational Testing Service (ETS). Further information on the 
content and properties of this test is given in Chapter 5. 

• GAIN program tracking data. So that the experimental group's patterns of 
participation in GAIN activities could be analyzed, participation data were 
collected manually from program casefiles or from computerized tracking 
systems. 

• Attendance data. To analyze hours of attendance and completion patterns of 
experimentals who participated in a basic education program, MDRC staff 
manually reviewed the attendance records of education providers in three counties. 
In a fourth county, San Diego, a computerized attendance system was used to 
obtain these data. 

• Staff Activities and Attitudes Survey. To describe the ways in which the 
counties implemented the GAIN model, the study draws on responses to the 
MDRC Staff Activities and Attitudes Survey. This survey was administered to 
GAIN staff twice in each county (one and two years after GAIN began) - during 
or slightly after the random assignment period in each county.^ 

• Field research. To describe the operation of GAIN basic education programs, 
MDRC conducted in-person interviews with administrators and teachers from 
selected schools in each county, primarily during the random assignment period. 
In addition, MDRC staff conducted a series of in-depth, in-person interviews with 
program case managers and administrators. 
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*See Friedlander, Riccio, and Freedman, 1993, for a detailed presentation of these impacts over a two-year 
period. 

^It was also administered approximately six months before GAIN began operations, but these survey data are 
not used in this report. 
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B. Subsamples and Follow>up Periods 

Of the data sources described above, the baseline data, AFDC, and UI records were available for 
the entire research sample who were determined to need basic education. All other types of data were 
obtained for subsets of this sample. Table 2.2 and Figure 2.3 describe the subsample for which each type 
of data was obtained and describe how these subsamples were selected. Appendix Figure B. 1 illustrates, 
for each county, the time period covered by random assignment and by each data source used in the 
study. Each of the major data sources, and the sample to which it applied, is discussed below. 

1. AFDC and UI records data > This report briefly discusses GAIN'S two-year impacts on 
employment, earnings, and welfare receipt for the full research sample of AFDC-FG and AFDC-U 
experimentals and controls (i.e., all those who were randomly assigned in each county). More than 
21,000 experimentals and controls - approximately 67 percent of whom were AFDC-FGs and 33 percent 
of whom were AFDC-Us - were determined to need basic education. (Of these, about 23 percent of 
the AFDC-FGs and 32 percent of the AFDC-Us were randomly assigned to the control group, with the 
actual proportions varying across the counties and over time in some counties.) 

Impacts are also briefly presented for an "early cohort," in each county, of AFDC-FGs and 
AFDC-Us who were judged to need basic education. These registrants were randomly assigned early 
during the period of sample intake, so a third year of follow-up data are available for them. However, 
the three-year impacts for a county's early cohort may not reflect those for its full research sample if its 
early and later registrants differed in their background characteristics, the labor market conditions they 
faced, the way GAIN was operated when they were in the program, and other factors. Therefore, the 
three-year findings included in this report should be interpreted cautiously. MDRC's final evaluation 
report, scheduled for 1994, will present impacts covering a minimum of three years for the full sample 
in each county, and longer for the early cohort. 

2. Registrant survey data . As Table 2.2 and Figure 2.3 illustrate, survey data were collected 
for a subsample of GAIN registrants. The survey sample is a stratified random sample drawn from all 
experimentals and controls in five of the six research counties. (Because resources for survey and test 
administration were limited, the survey was conducted in the five largest counties and Butte was not 
included).^" Registrants who were not proficient in English, Spanish, or Vietnamese were not included 



'^As noted above, these two-year impacts are presented in detail in Friedlander, Riccio, and Freedman, 1993. 
''Ibid. 

'^The sample was stratified based on applicant/recipient status, prior employment history, prior welfare history, 
and, finally, a random number. This was done in order to produce a random sample that would be representative 

(continued...) 
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FIGURE 2.3 



RESEARCH SAMPLES FOR THE GAIN STUDY OF THOSE 
DETERMINED TO NEED BASIC EDUCATION 



All Experimentals and Controls Determined to Need 
Basic Education in the Six Research Counties: 
Alameda, Butte, Los Angeles, Riverside, San Diego, Tulare 
(N«21,596) 



A stratified random sample of 
experimentals and controls in all counties 
except Butte was chosen for the GAIN 
registrant sun/ey and TALS samples 



All experimentals 

in Alameda 
and Los Angeles 



GAIN Registrant Survey Sample 
(N« 3,210) 



Randomly selected 

sample of 
experimentals in 
Butte, Riverside, 
San Diego, 
and Tulare 



1 



Additional randomly 

selected sample 
of experimentals in 
Butte, Riverside, 
San Diego, 
and Tulare 



AFDC-FG 
registrants who 
could speak English 
and were considered 
likely to participate 
in basic education 
were included in the 
TALS sample 




Participant Flow Sample 
(N s 4,523) 



Participated in a basic education program 
(excluding Alameda and Los Angeles) 



Survey 
Respondents 
(N« 2,551) 



Attendance 

Sample 
(N« 1,222) 



Sun/ey respondents who were In the TALS 
sample were given the TALS test 



TALS 
Respondents 
(N« 1,119) 
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in the survey sample. As illustrated in Appendix Figure B.l, the survey sample was drawn from a 
specified time period in each county » which did not cover the entire random assignment period. The 
survey sample consists of 1 1 percent of the experimental group members and 26 percent of the control 
group members and was selected to yield an equal number of experimental and controls in each county 
except Riverside. Riverside had two experimental groups; an equal number of sample members from 
each of them, and from the control group, were selected. Thus, unlike the survey samples in the 
other counties, the Riverside survey sample is composed of two-thirds experimentals and one-third 
controls. The survey sample for the group determined to need basic education included 3,210 registrants 
in all (2,808 AFDC-FGs and 402 AFDC-Us). 

The survey subcontractor was able to locate and administer the survey to 2,55 1 of these registrants 
(2,258 AFDC-FGs and 293 AFDC-Us), for an overall response rate of almost 80 percent. There were 
few significant differences in the characteristics of responders and nonresponders; there was also a close 
match between the characteristics of experimentals and controls. Appendix A provides more details on 
response rates and response bias. 

The survey encompassed registrants' experiences during the period from random assignment until 
the survey administration date. In three counties - Riverside, San Diego, and Tulare ~ the survey 
occurred roughly two years after random assignment. Survey administration occurred later in Alameda 
(averaging 30 months after random assignment) and Los Angeles (averaging 37 months after random 
assignment). The findings are generally not sensitive to the different follow-up periods. (Chapters 3 and 
4 discuss analysis issues related to the longer follow-up periods in some counties.) 

3. Literacy test (TALS) data . The sample included in the TALS test analysis was a subset of 
the survey sample described above. The TALS sample included all AFDC-FG experimentals and controls 
from the survey sample who were determined to need basic education except those who met specified 
criteria. Non-English readers (i.e., those who had not taken the CASAS tests at the time of random 
assignment because they were not proficient in English) were not included in the TALS sample because 
the TALS was not appropriate for them. 



^^(... continued) 

of the whole group in terms of these key characteristics. The final sort by a random number ensures that individual 
sample members were chosen at random. 

'^Riverside had two experimental groups because of a special study in that county of the effects of higher versus 
lower registrant-to-case-manager ratios. However, the two experimental groups have been combined for the present 
study. 

•''MDRC contracted with NSI Research Group to conduct the survey. 
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In addition, individuals who were judged to need basic education but did not participate in this 
activity were not expected to obtain TALS score impacts. Therefore, sample members who were 
considered less likely to participate in basic education were not included in the TALS sample. This 
criterion was used only for the selection of later cohorts of the TALS sample in Alameda, Los Angeles, 
and Tulare. Three groups of registrants were considered less likely to participate in basic education 
and were not included in the TALS sample: (1) those who had a high school diploma or a GED at the 
time of random assignment, (2) those who were working more than 15 hours per week at the time of 
random assignment, and (3) those who were enrolled in a school or training program at the time of 
random assignment. Survey sample members who met any of these criteria were not included in the 
TALS sample. The TALS sample is therefore less representative of the overall impact sample than is 
the survey sample as a whole. However, the character of the TALS sample makes it possible to capture 
more accurately the TALS score impacts associated with participation in basic education activities, 
particularly ABE and GED activities. 

Overall, 61 percent of AFDC-FG experimental and controls in the survey sample were included 
in the TALS sample. The TALS sample included 1,875 registrants in all. However, two factors reduced 
the size of the sample. First, completed tests for 108 sample members from Riverside, San Diego, and 
Tulare were not received because of a shipping error. Second, owing to problems in administering the 
test, 48 cases from Alameda were determined, during the validation process, to be invalid. These cases 
were dropped from the TALS sample, reducing its size to 1,719 registrants. TALS test scores are 
available for 1,119 of these registrants, for an overall response rate of 65 percent. 

There were few significant differences in background characteristics of those in the TALS sample 
who completed the TALS test and those who did not. Also, there was a close match in the characteristics 
of experimentals and controls. The loss of 156 sample members did not introduce any significant bias 
into the TALS sample. 

4, GAIN program tracking data . The sample for whom GAIN program tracking data were 
collected is referred to as the "participant flow sample" throughout this report. In four counties (Butte, 



'^The proportion of the TALS sample that was selected using this criterion was 56 percent in Alameda, 40 
percent in Los Angeles, and 38 percent in Tulare. Across all five counties, 46 percent of the TALS sample were 
selected on the basis of their being likely to participate in basic education. 

'^These individuals, most of whom were enrolled in vocational training or post-secondary programs, could 
continue in their self-initiated program (if approved by GAIN staff) to fulfill the GAIN participation requirement. 
This group was considered unlikely to be referred to or to participate in a basic education program. 

'''Scores for four respondents were not available for the TALS impact analysis because key identifying 
information about these individuals was missing. 
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Riverside, San Diego, and Tulare), data on GAIN program activity were collected manually from GAIN 
casefiles. The participant flow sample in these counties was a randomly selected, stratified sample chosen 
from the experimental group. As illustrated in Appendix Figure B.l, in these four counties, the 
participant flow sample did not cover the entire random assignment period. In general, it was drawn 
from an earlier cohort than was the survey sample. MDRC collected 1 1 months of program participation 
information on all members of the participant flow sample. In Alameda and Los Angeles, participant 
flow data were collected from computerized tracking systems, making it possible to include in the 
participant flow sample for those counties all experimentals from the entire random assignment period. 
In total, the participant flow sample in the six counties, for those determined to need basic education, 
consisted of 3,381 AFDC-FG registrants and 1,142 AFDC-U registrants. 

5. Attendance data . MDRC collected 12 months' worth of information about hourly attendance 
in and completion of basic education activities for a subsample of experimentals in four counties (Butte, 
Riverside, San Diego, and Tulare). In three of these counties (Butte, Riverside, and Tulare), these data 
were collected manually from providers' records. Providers' records for almost all of the schools serving 
GAIN registrants in each county were reviewed; only a few schools were not included in the analysis, 
because they either served very few GAIN registrants or had poor-quality data. (See Appendix Table B. 1 
for the schools in each county included in the data collection effort.) 

The attendance sample consisted of two groups. First, all those in the participant flow sample who 
attended a basic education program were included. Second, in order to increase sample sizes, an 
additional subsample of AFDC-FG experimentals who were determined to need basic education and who 
were from the same cohort as the participant flow sample were randomly selected from each county. 
MDRC reviewed records at each basic education provider to determine whether these additional sample 
members had attended. If they had, they were included in the attendance sample. 

In San Diego, a computerized attendance file was used» allowing MDRC to obtain data for all 
AFDC-FG and AFDC-U experimentals who participated in a basic education program. However, only 
experimentals from the same random assignment period as the participant flow sample were included in 
the analysis. In two schools in San Diego, the automated data were of poor quality. Thus, the attendance 
data for a subsample of experimentals at these schools were collected manually. Because of the 
automated system, attendance data were available for a much larger subsample in San Diego than in the 
other counties (662 AFDC-FG registrants and 191 AFDC-U registrants). 

Across all four counties, attendance data were obtained for 961 AFDC-FG and 261 AFDC-U 
sample members who participated in a basic education program. Attendance data were not collected in 
Alameda or Los Angeles. 
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IV* Background Characteristics of the Full Sample for This Report 

Table 2.3 displays selected characteristics of the full sample^^ of AFDC-FGs who were judged 
to need basic education in each county (with the experimental and control groups combined). Table 2.4 
presents the same information for the AFDC-U group. Differences in the characteristics of the 
counties' research samples are important because they may have contributed to differences in registrants' 
participation patterns and program impacts and costs. In this report, the educational background of 
sample members is particularly important. 

Table 2.3 reveals some striking contrasts in the background characteristics of the counties' 
research samples. For example, unlike samples in all of the other counties, those in Alameda and Los 
Angeles included virtually no individuals who, at the time of their referral to GAIN, were AFDC 
applicants or short-term recipients. This reflects the special intake policies in those two counties, which 
were noted above. Furthermore, in the AFDC-FG group in the other four counties, the proportion of 
long-term recipients (who had received welfare for more than two years) ranged from 32 percent in Butte 
to 61 percent in Tulare. Across the six counties, the proportion who had worked for pay during the two 
years prior to GAIN orientation ranged from 16 percent in Los Angeles to 53 percent in San Diego. The 
counties also varied widely in racial and ethnic composition. For example, 10 percent of Los Angeles's 
sample were non-Hispanic whites, compared to 80 percent of Butte's. Four counties (Los Angeles, 
Riverside, San Diego, and Tulare) had substantial Hispanic populations (roughly one-third of the sample). 

As discussed in Chapter 1, GAIN registrants are determined to be in need of basic education if 
they do not have a high school diploma or a GED, score below 215 on either the reading or mathematics 
CAS AS test, or are not proficient in English. Table 2.3 gives the reasons registrants were determined 
to need basic education across the six counties. An important distinction across the counties was the 
proportion of the research sample who had a high school diploma or a GED but were determined to need 
basic education because they scored below 215 on either of the two CAS AS tests. This rate ranged from 
38 percent in Alameda to 12 to 20 percent in the other counties. The remainder did not possess a high 
school diploma or a GED; in addition, more than half of these individuals in most counties scored below 
215 on one or both CAS AS tests. It is notable that 39 percent of the sample in Los Angeles were 



•*The fall research sample of 21,596 registrants shown in Table 2.2 contains 204 cases that were not included 
in the impact sample because social security numbers and/or AFDC case numbers were missing, or for other 
reasons. These cases were not included in the impact analyses in this report, although they were included in the 
background information presented in this section. 

'^Characteristics of the survey and TALS samples are presented in Appendix Tables B.2 and B.3. 
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determined to be in need of basic education because of limited English proficiency, compared to 7 to 28 
percent in the other counties. 

The differences in education levels across the counties is also indicated by the proportion who 
scored 215 or higher on both CAS AS tests. This ranged from a low of 8 percent in Los Angeles to a 
high of 38 percent in Butte. Sample members fared better on the CAS AS reading t ;st than on the 
mathematics test. In all counties except Los Angeles, roughly two-thirds scored 215 or higher on the 
reading test, while a smaller proportion - ranging from 8 to 39 percent ~ achieved this score on the 
mathematics test. In Los Angeles, many individuals did not take the CAS AS tests because of their limited 
proficiency in English. 

In contrast to the AFDC-FG group, the AFDC-U sample members were less likely to be long-term 
welfare recipients (except in Alameda and Los Angeles), more likely to have been employed in the prior 
two years (except in Alameda), and more likely to have been determined to need basic education because 
of their more limited knowledge of English. AFDC-Us also included a higher proponion of heads of 
families who were refugees from Vietnam, Laos, Cambodia, and other countries. More than one-half 
of the AFDC-U samples in Alameda and Los Angeles were Indochinese or members of other Asian 
groups. 
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CHAPTER 3 

PATHWAYS INTO AND OUT OF BASIC EDUCATION. AMOUNT OF PARTICIPATION, 



AND ATTENDANCE PATTERNS 



This chapter describes the experiences in the GAIN program of registrants determined to need 
basic education. It focuses on GAIN*s basic education activities because they were the key, although not 
the only, program element provided to these welfare recipients. This chapter begins by discussing the 
nature of the basic education services received by these registrants in the six research counties. It then 
describes the amount of basic education received through the GAIN program by examining what 
proportion of registrants participated in basic education services (as well as other types of services), how 
long and how intensively they attended the activities, to what extent they completed the activities, and 
how these factors varied by county. 

The purpose of this analysis is to document the "treatment" those considered in need of basic 
education received when they enrolled in the GAIN program. Because this defines the nature of the 
"investment" made in basic education, it is important for interpreting the impacts presented in Chapter 
5. This chapter discusses what happened to individuals who enrolled in GAIN, and thus reports on 
results for the experimental gioup only (i.e., not for the control group). 

I. The Basic Education Programs in GAIN 

As discussed in Chapter 1, basic education in GAIN consists of three types of instruction: GED 
preparation. Adult Basic Education (ABE), and English as a Second Language (ESL). Individuals enroll 
in one or another of these components depending on their skills levels. GED preparation programs are 
designed for students who ?.re at education levels that permit them to study productively for the GED test. 
The GED examination is fairly academic in nature and consists of five tests of high school performance 
in the following areas: social studies, literature, science, mathematics, and essay -writing. ABE programs 
provide remedial reading and mathematics for individuals at lower levels of skills, generally below the 
eighth-grade level. ESL activities provide individuals who are not proficient in English with instruction 
in reading and speaking that language. 

Implementing GAIN'S basic education component required the development of a new service 
relationship between welfare agencies and education systems. Prior to GAIN, adult education systems 
had primarily served individuals who had volunteered for services and thus, for the most part, were ready 
to make the commitment to returning to school and had attempted to resolve any significant barriers to 



attending. Under GAIN, education providers are required to serve a new, mandatory, and relatively 
disadvantaged population on an ongoing basis until they finish the program's requirements or leave 
welfare. Most of those who are required to participate in basic education are school dropouts and have 
a history of negative experiences in school. They may lack the motivation, confidence, and school- 
relevant skills possessed by those who volunteer for services. Furthermore, all are parents, suggesting 
that there are competing demands on heir time and attention.^ 

This section explores how the basic education services for GAIN students were put in place by 
the counties and the characteristics of the education programs. It also assesses whether an "opportunity 
to learn" was provided to GAIN students in these programs, "Opportunity to learn" is a term used by 
education analysts who have made efforts to assess the quality of educa-v.;cn in various school programs.^ 
Service quality in education has been difficult to define and measure, and little is known about the 
program characteristics that constitute high-quality education, particularly in adult education programs.^ 
In addition, many argue that the components of quality education cannot be identified a priori, but rather 
should be measured in terms of education outcomes. Thus, in the absence of program characteristics that 
are known to be related to quality or to clear education outcome measures, determining whether an 
opportunity to learn is present is a means of assessing whether it is reasonable to expect that learning 
could take place. In this report, the judgment as to whether an opportunity to learn was provided was 
based on conventional standards: whether students had access to adequate curricula, instructional methods, 
teachers, and hours of instruction. The description of basic education programs presented below is 
provided with the goal of assessing whether an opportunity to learn was offered. The education outcomes 
resulting from the GAIN program are presented in Chapter 5. 

Overall, as discussed in this section, the six research counties were successful in providing basic 
education services for this new group of students that provided an opportunity to learn. There were, 
however, some important differences in the structure and content of the services. MDRC observed that 
counties and schools followed one of two patterns in providing these services. In most counties and 
schools, the services were the standard, preexisting basic education programs offered by the adult 
education system in the community, with few changes having been made to their content. However, 
some counties and some schools within counties followed a different path. In these places, and in San 
Diego in particular, efforts were made to redesign the education services specifically to the needs of the 



For further discussion of these issues, see Riccio et al., 1989, and Pauly, Long, and Martinson, 1992. 
^See, e.g., O'Day and Marshall, 1993. 
^See Grubb et al., 1991. 
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GAIN population by developing alternative ways to teach and support students. Table 3.1 summarizes 
the characteristics of basic education services provided to GAIN registrants in each county. A fuller 
description is given below. 

A, Organizing the Education Services 

In order to provide basic education services for GAIN students, each county established a service 
network with basic education providers in the community. It is important to point out that the GAIN 
program was implemented in a state with a sizable adult education system already in place: California's 
system is the largest in the country, serving more than one-third of all adult basic education students in 
the United States, and accounting for 19 percent of total U.S. expenditures on adult education."* The 
state's large adult education infrastructure was an important element in the ability of the system to 
accommodate the influx of GAIN students. 

As shown in Table 3.1, adult education schools were the most common providers of basic 
education, although a few counties also depended on community colleges and community-based 
organizations. The number of providers used in each county ranged from two schools in Butte to 47 
schools in Los Angeles. GAIN registrants were most often assigned to the school closest to their home. 
The schools predominantly operated programs that were open entry/open exit (i.e., students could enter 
and leave programs throughout the school year). 

In most counties, the primary outcomes of the linkage between the education and welfare systems 
were the establishment of referral processes to ensure GAIN registrants' being directed to available slots 
and the development of procedures for monitoring GAIN registrants' attendance and classroom 
performance (an issue discussed later in this chapter). For the most part, the GAIN programs were 
successful in accessing slots in existing basic education programs. This task was particularly challenging 
in Los Angeles, where the GAIN program was large and there were 47 schools. The program secured 
a sufficient number of slots, and a referral and monitoring system, by contracting with three intermediary 
agencies to coordinate the provision of basic education services.^ 

San Diego was the exception to this pattern. This county initiated a new and separate system for 
providing basic education to all GAIN registrants in the county who had been determined to need it. The 
GAIN program and several school districts collaborated to redesign basic education services specifically 
for GAIN students, based on the premise that the existing services offered by the adult education system 



'^See Development Associates, 1992, p. 85. 

^The GAIN program contracted with the Los Angeles Unified School District » the Los Angeles Community 
College District, and the County Office of Education. 
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were not appropriate. One welfare administrator commented as follows: "These people had an 
unproductive experience in school and were not able to benefit. We wanted to avoid the perception that 
they were going back. We wanted to make it different and make it work for them." 

During the planning stages of the GAIN program in San Diego, a consortium of representatives 
from six school districts, the welfare department, and the Private Industry Council (PIC) was founded 
to develop the GAIN basic education services. This resulted in a new network of 21 specialized Learning 
Centers (i.e., classrooms) designed specifically and exclusively for GAIN students. A Learning Center 
model was uniformly employed in all the classrooms. Its major features were computerized instruction 
using up-to-date technology and software, individualized instruction, specially hired teachers, and off- 
campus, storefront locations to reinforce the idea of a fresh opportunity. 

Tulare also added some specialized services, although not to the extent of San Diego. Like Los 
Angeles, Tulare contracted with the County Office of Education (COE) to act as the intermediary for 
education services and to set up a county-wide attendance and performance monitoring system for all 
seven schools that provided basic education services to GAIN students. The COE also hired several 
"transition counselors" serving all GAIN basic education students in the county. Their exclusive function 
was to respond to the needs of GAIN students while they were in education programs. They assisted with 
the attendance, academic, and personal issues that clients confronted while they were in the program, and 
they were on-site at each school several days per week. 

Overall, the schools had the capacity to handle students referred from the GAIN program. The 
only significant problem was in San Diego, where the supply of basic education slots early on was not 
adequate and a waiting list developed. 

An interesting decision faced by welfare and school administrators was whether to place GAIN 
registrants in separate classes. As shown in Table 3.1» some schools placed GAIN students in existing 
classes to avoid isolating (and possibly stigmatizing) them or because GAIN enrollments were insufficient 
to warrant separate classes. Others set up classes serving only GAIN registrants in order to efficiently 
accommodate the monitoring requirements or special instructional needs of these students. As mentioned 
above, San Diego was unique in that all schools involved in the GAIN program created classrooms 
devoted exclusively to GAIN students. 

Like other adult basic education programs in California, GAIN'S are supported primarily by the 
State Department of Education's Average Daily Attendance (ADA) funds, which are paid according to 
a formula based on the number of students attending a school. As Table 3. 1 shows, four of the research 
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counties contributed additional GAIN fiinds, and five also used JTPA ftinds.^ These additional funds 
were used for the increased monitoring of attendance and performance required for GAIN students, and 
some were used to augment classroom services (as described below). In one county. Riverside, the 
GAIN program developed and funded innovative performance-based payments with several schools.'' 

According to one study, in the fiscal year ending in 1990, the state spent $205 per adult education 
student (including both GAIN and non-GAiN students and funding from all sources). ^ Overall, 
California ranked twenty-seventh in the nation in terms of expenditure level per student (the national mean 
was $258 per student). Thus, for the most part, the programs serving GAIN students were funded at 
moderate levels. 

The amount of instruction offered per week varied by county, and usually by school. During the 
study period, most providers offered instruction for 12 to 20 hours per week - three to four hours per 
day, four to five days per week. Most classes were held during the day. San Diego imposed a more 
demanding schedule - 27 hours per week - in all the schools in the county. The "20-hour rule- 
specified in the JOBS regulations took effect in California in October 1990.^ At that time, many schools 
increased their scheduled hours to 20 per week. However, this was after the random assignment period 
in each county, although it was during the follow-up period for some data sources used in this report. 

In summary: The six counties were successful in arranging the basic education services for GAIN 
registrants. The next section discusses the content of the classroom activities. 

B. Classroom Activities 

As discussed above, in most counties the welfare department did not exert much control or 
influence over the content of education; the education providers determined the curricula and classroom 
activities. Most of the schools relied on the program activities they had in place when GAIN was 
implemented and did not change them significantly for GAIN. Thus, GAIN students generally received 
the same basic education services provided to other adults in California. 

At most schools, students were assessed in order to determine an appropriate classroom placement 



^State Job Training Partnership Act (JTPA) "8 percent funds" are set aside for education. In California a 
portion has been specifically earmarked for GAIN participants. 

^For GED and ABE students, the schools in Riverside received SlOO for a GAIN student's initial placement 
testing and enrollment, $100 for each grade level a student advanced on the Tests of Adult Basic Education (TABE) 
$225 for a student's attaining a GED, and $26 per student per month attended. For ESL students, the payments 
were not performance-based; instead, GAIN provided $2.61 per instructional hour per ESL student. 

"See Development Associates, 1992, pp. 84-85. 

'This regulation requires monthly participation in a variety of activities that average 20 hours per week or more 
in order to meet federal participation requirements. 
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(GED, ABE, or ESL) and to identify discrete skills deficiencies (in both reading and mathematics). 
For those determined appropriate for an ABE or ESL class, an individualized program was typically 
developed, which indicated specific skills that should be learned. These skills were usually ordered 
in a hierarchy from easy to difficult. For example, in reading, low-level students started by decoding 
words and moved to decoding sentences, reading paragraphs for their direct meaning, and reading 
passages for more complex inferences. In mathematics, low-level students progressed through addition 
and subtraction, multiplication and division, fractions, percentages, and more complex word problems. 
Individuals in a given classroom typically had a range of achievement levels and worked on a self-paced; 
individualized set of assignments. 

Teachers monitored students* academic progress at designated intervals - typically every 100 to 
200 hours. Assessment methods ranged from standardized tests administered periodically to teacher- 
developed assessments, such as the completion of a particular unit or chapter in a textbook. 

For ABE and ESL classes, teachers relied on a mix of whole-class teaching, small groups, and 
computer-based instruction. On a typical day, part of the class time was spent on a group lesson — 
usually in the form of lecture - in which students at all levels participated. Classes often broke down 
into smaller groups, and some or all students worked independently on individual assignments. Many 
teachers also reported that peer-based instruction was used, with the more advanced students in the class 
assisting the others. The programs generally used published textbooks and workbooks as well as teacher- 
and student-developed materials. Most students had their own course of study, with a particular mix 
of materials, although common activities included fill-in-the-blank exercises, reading exercises, and 
arithmetic problems. There was no consistent use of employment-related or real-life examples in 
instruction across the schools. 

A majority of the schools in all counties provided computer-assisted instruction (CAI). Most 
commonly, this was in the form of a "lab," which students from all types of programs (GED, ABE, and 
ESL) used a few hours a week. Throughout the study period, the basic education programs in all 
counties generally became more automated and expanded the capacity of their CAI.^'^ There was, 



'^'standardized tests - most commonly the Tests of Adult Basic Education (TABE) - are used for this 
assessment. In some instances, ABE and GED students were taught together in the same classroom, although this 
was not common. 

Issues concerning completion criteria are discussed later in this chapter. 
'^For a further description and a discussion of the pros and cons of this approach, see Grubb et al., 1991 . 
'^Curricula published by Steck- Vaughn and Scott Foresman were widely used in these programs. 
''^Riverside used JTPA funds to add a WASATCH computer lab to each of the contracted schools. Several 
providers in Tulare added the WASATCH system to their curricula in the early 1990s. The program offered 

(continued...) 
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however, some variation in the degree to which schools stayed current with technology and software. 

GED classes were somewhat different from ABE instruction in that the instruction in the class was 
geared overwhelmingly toward completion of the GED test.^^ GED instruction primarily used published 
GED preparation and practice test materials, typically those developed by Contemporary or Cambridge 
publishers, as well as CAI packages developed for GED preparation. Students determined by the initial 
assessment process to be appropriate for GED classes took a complete GED practice test to ascertain in 
which areas to concentrate. Students sometimes studied for one GED test section at a time, took that 
particular segment of the test when they were ready, and then moved on to the next section. 

San Diego is distinctive from the other counties in that it developed the curriculum for GAIN 
students from the ground up. This was possible because, as discussed above, the GAIN program did not 
refer students to an existing institution, but instead created a program from scratch. A few individual 
schools within some of the other counties ~ notably in Los Angeles, Riverside, and Tulare ~ also 
adapted their curricula and classroom activities specifically for GAIN students. The system in San Diego 
stands out, however, because it was implemented county-wide. 

In San Diego, the interagency consortium established a committee to develop and select the 
appropriate curriculum for the Learning Centers. One of the committee's main priorities was to develop 
a program based on CAI because it was viewed as a way of distinguishing the education services in GAIN 
from those previously received by this group of students. The committee also wanted a curriculum that 
"treated people like adults." Thus, focusing the instructional materials on life skills was considered to 
be important. After an extensive review of software programs, the county selected the PLATO and 
WASATCH packages as its primary CAI curricula. In addition, staff continuously reviewed and assessed 
new software packages, and added other software programs as appropriate. In addition to using 
computer-based instruction, instructors also employed a range of published and teacher-developed 
materials. 

Administrators in San Diego reported that roughly 40 percent of a student's day was spent at the 
computer - more than was typical in other counties. ABE and ESL instruction combined a life skills 
and academic focus and relied to a greater extent on CAI than did most programs in other counties. 
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through the Los Angeles Community College District used the PLATO software as a key component of their 
curriculum. 

^^According to the National Evaluation of Adult Education, which surveyed a national, random sample of adult 
education providers, the classroom activities described in this section are common in adult education programs. 
See Development Associates, 1992. 

'^In California, students are not required to take the entire GED test in one sitting. 
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However, as in the other research sites, the San Diego GED programs remained focused on preparing 
students for the GED test. 

Another distinctive feature of San Diego's basic education system was the hiring of a new teaching 
staff for the program. Teachers were selected based on their experience working with the adult 
population, but also because they recognized that the GAIN population would have different needs from 
the traditional adult education population. The county was looking for teachers who could "turn around" 
more difficult students who might be reluctant to return to school. 

C. Assessing the Opportunity to Learn Provided by the Basic Education Programs 

The MDRC Staff Activities and Attitudes Survey, which was administered during or slightly after 
the random assignment period in each county, asked GAIN staff to rate "how worthwhile" each service 
was to the GAIN registrants who were assigned to it. It is likely that these judgments reflect what staff 
learned about the activities from registrants and, in some cases, from their own visits to, or other contacts 
with, the schools or agencies providing the basic education services. Figure 3.1a shows the percentage 
of GAIN staff who gave "high" scores to the education services^^ and indicates that staff views of this 
activity were mostly positive, particularly in San Diego and Tulare, where approximately three-quarters 
of the staff gave the services a high rating. Interestingly, these are also the counties where the most 
adaptations and service enhancements were made to accommodate GAIN students. 

Overall, although an exact assessment of the quality of the education services cannot be provided, 
it can be concluded that, at a minimum, GAIN students received the standard basic education services 
given to all adults in California. These services appear to have offered a real opportunity for students 
to learn basic skills: There were very few capacity problems; the services were geared toward individuals* 
educational deficits and used established methods and curricula; and classes were available for a 
significant number of hours per week on a continuing basis. In addition, particularly in San Diego but 
also in some schools in other counties, efforts were made to go beyond the standard adult education 
curricula and to improve the basic education services provided to GAIN students, using additional funding 
and different curricula and instructional methods. Whether, in fact, the specific curricula or instructional 
m( thods used were effective in helping individuals in these programs learn basic s^dlls cannot be 
addressed solely by examining the characteristics of these programs. It is also important to consider the 
education outcomes produced by the GAIN program, which are addressed in Chapter 5. 



'^"High" scores meant a score of 6 or 7 on a seven-point scale. 
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FIGURE 3.1 

COUNTY DIFFERENCES IN SELECTED GAIN IMPLEMENTATION 
PRACTICES AND CONDITIONS 
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SOURCE: MDRC Staff Activities and Attitudes Survey administered during study period. 
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IL Pathways into and out of Basic Education 

The remainder of this chapter examines participation patterns for members of the experimental 
group. To interpret the resuhs of the GAIN evaluation's impact analyses and to define the magnitude 
of the investment made in basic education, it is essential to understand the extent to which individuals in 
the experimental group who were determined to need basic education took part in GAIN activities, 
particularly basic education services. This section of the chapter reviews and summarizes information 
presented in previous MDRC reports on GAIN.^^ 

Figure 3.2 provides an overview of the "flow" through GAIN for those registrants who were 
determined to need basic education. Specifically, it traces the flow of 100 typical GAIN registrants 
through the program over the 11-month period following their attendance at a GAIN orientation (with 
all six counties combined and weighted equally). The figure shows the number who participated in basic 
education services as well as the reasons for nonparticipation. As the figure illustrates, only a portion 
of those who were determined to need basic education received the service: 58 of 100 AFDC-FG (single- 
parent) registrants determined to need basic education were referred to basic education activities, and 41 
of the 58 actually participated in such an activity. 

There were two main reasons why a relatively large proportion of registrants did not participate 
in a basic education program. First, the GAIN legislation permits a temporary deferral from the 
participation requirement for those who have a part-time job, temporary illness, or another situation that 
precludes attending an activity; many registrants did not reach a basic education activity within the 11- 
month follow-up period because they were temporarily deferred from the GAIN program. Second, 
registrants are also not required to remain in GAIN if they leave AFDC or if they meet certain exemption 
criteria such as getting a full-time job or becoming chronically ill; as Figure 3.2 shows, many registrants 
left the GAIN program (i.e., were "deregistered") before they participated in a basic education activity. 
In addition, some registrants selected, or were referred to, other services, particularly job search. (As 
noted in Chapter 1, registrants are allowed to choose between job search and basic education as their 
initial activity.) Finally, some registrants, with GAIN'S approval, continued in posl-secondary education 
or vocational training courses they nad begun prior to enterir.g GAIN. (In GAIN, these are referred to 
as "self-initiated" activities.) 



'^See Freedman and Riccio, 1991, and Riccio and Friedlandcr, 1992. 

^^Most measures on Figure 3.2 report data from all six counties combined, with each county weighted equally. 
Data on completion or noncompletion of basic education, and on statuses after basic education, were not available 
for Alameda or Los Angeles. Thus, data from four counties (Butte, Riverside, San Diego, and Tulare) were used 
for these estimates. 
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FIGURE 3.2 



CLIENT FLOW WITHIN AN 11-MONTH FOLLOW-UP PERIOD 
FOR 100 TYPICAL AFDC-FG AND 100 TYPICAL AFDC-U GAIN EXPERIMENTALS 
DETERMINED TO NEED BASIC EDUCATION 



GAIN Eiq^rimentals Who 
Attended Orientation and Were 
Determined to Need 
Basic Education 
AFDC-FGs:100 AFDC-Us:100 



Referred to 
Basic Education 

AFDC-FGs:58 AFDC-Us: 54 



Participated in 
Basic Education 

AFDC-FQs:41 AFDC-Us: 39 



i 



Not Referred to 






Basic Education 


AFDC-FGs 


AFDC-Us 


Deferred 


19 


26 


Deregistered 


11 


9 


Referred to Job Ciub or Job Search 5 


8 


In Self-Initiated Activity 


4 


2 


Other 


3 


1 




Did Not Participate in 






Basic Education 


AFDC-FGs 


AFDC-Us 


Deferred 


4 


4 


Deregistered 


5 


5 


Referrev-* to Job Club or Job Search 4 


4 


Participated After Fotlow-Up Period 3 


2 


Other 


2 


1 



Completed 
Basic Education (a) 

AFDC-FGs: 8 AFDC-Us: 5 



Still Active in 
Basic Education 
at End of Fotiow-Up (a) 

AFDC-FGs: 8 AFDC-Us: 10 



1 



Stopped Attending 
and Did Not Complete 
Basic Education (a) 

AFDC-FGs: 25 AFDC-Us: 24 



Next Activity or 
Status (a) 

Deferred 
Deregistered 

Referred to Job Club or Job Search 
Referred to Post-Secondary Education 
In GAIN, No Activity or Status 



AFDC-FGs AFDC-Us 

0 0 

0 0 
5 3 

1 0 

2 1 



Next Activity or 






Status (a) 


AFDC-FGs 


AFDC-Us 


Deferred 


9 


6 


Deregistered 


7 


9 


Referred to Job Ciub or Job Search 


2 


1 


Referred to Other Activities 


1 


1 


In GAIN, No Activity or Status 


6 


7 



SOURCE: MDRC*s participant flow sample. 

NOTES: The tlx counties were weighted equally. 

Numbers n^ay not turn to totals because of rounding. 

(a) Data on completion or noncompletlon of basic education and on participants* activities or status after 
basic education were not available for Alameda or Los Angeles. 
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Figure 3.2 continues by showing what happened to registrants once they reached a basic education 
activity. Within the 1 1 -month period, 8 of 41 (20 percent) of those who participated in basic education 
completed their basic education activity (according to school records), with most of them going on to a 
job search activity. Twenty-five of 41 (61 percent) who participated stopped attending the basic education 
activity without finishing it primarily because, again, they were deferred or deregistered from GAIN. 
Finally, 8 of 41 (20 percent) were still participating in the activity at the end of the follow-up period. 

In sum, a majority (roughly 60 percent) of those determined to need basic education did not 
participate in a basic education program within the follow-up period. However, the reasons for 
nonparticipation were almost always consistent with the GAIN legislation, and some participated in 
another GAIN activity (e.g., 9 of 100 of the AFDC-FG registrants were referred to a job search activity 
and did not participate in basic education within the follow-up period). Thus, given the GAIN 
legislation's provisions regarding deferrals and deregistrations, normal welfare caseload turnover, and 
the use of job search by some registrants, much higher rates of participation in basic education would 
have been difficult to achieve. In addition, many registrants stopped attending their basic education 
programs without completing them. Again, registrants left these activities for reasons that were in 
accordance with the GAIN legislation. Similar patterns held for AFDC-U (heads of two-parent families) 
registrants. 

It is important to point out that some individuals may not have wished to return to school or to 
remain in GAIN'S basic education activities. They may therefore have found employment or established 
other reasons for not participating (or continuing to participate) in basic education. The extent of such 
behavior was not measured for this report. However, program staff report that, although this did 
sometimes occur, many registrants overcame their initial hesitancy and returned to school. Given the 
observed participation levels, it appears that GAIN'S mandate has been successful in getting a sizable 
number of welfare recipients to return to school, although a positive school environment and, as discussed 
later in this chapter, attendance monitoring and follow-up are important for maintaining participation. 

IIL County Participation Patterns and Emphasis on Basic Education 

The analysis in the preceding section presented an overview of participation patterns for those 
registrants determined to need basic education, with all six counties combined. It is also important to 
understand how the patterns varied across the counties. Like Section II, this section of the chapter 



-49- 



ERLC 



reviews and summarizes information presented in previous reports. Although the GAIN model 
prescribes a set sequence of services, individual counties presented different messages to program 
registrants about the use and value of education and training activities versus job search activities. 

The participation patterns of GAIN experimental in each of the six counties are presented in Table 
3.2 (for AFDC-FG registrants) and Table 3.3 (foi AFDC-U registrants). The tables display the incidence 
of participation in each GAIN activity calculated in two different ways.^^ In each table, the top panel 
presents these rates for all registrants, including those who never started an activity. This approach is 
helpful for understanding the extent to which the entire sample received particular kinds of services. The 
bottom panel presents several participation rates for only those who ever participated in any GAIN 
activity. The latter measure is useful for comparing the mix of services across counties. These results 
are also totaled for all six counties, with each weighted equally. 

These data show that, in each of the six research counties, basic education was the most common 
type of activity for those determined to need it. (Job search was the second most common.) Depending 
on the county, between 27 and 56 percent of AFDC-FG registrants who were determined to need basic 
education entered such activities. ^2 Moreover, as the bottom panel in the two tables make evident, basic 
education was the most heavily used activity for those who actually participated in a GAIN activity, 
particularly in Alameda, Los Angeles, and Tulare. In these counties, the vast majority of those 
determined to need basic education, ranging from 83 to 91 percent of the AFDC-FGs, participated in 
basic education activities. Participants in Riverside and San Diego used job search and basic education 
in more equal proportions. 

Tables 3.2 and 3.3 also show the extent of participation in each type of basic education activity 
(GED, ABE, and ESL). The six counties used these activities to different degrees, depending on the 
nature of their GAIN population. For example, reflecting its more disadvantaged population, Los 
Angeles had the lowest proportion of AFDC-FG GAIN participants in GED programs (15 percent) and 
me highest proportion in ESL programs (28 percent). In contrast, 47 percent of the AFDC-FG GAIN 
participants in Tulare attended a GED program. The participation patterns of AFDC-U registrants were 



^^See Freedman and Riccio, 1991, and Riccio and Friedlander, 1992. 

^^There are many ways to define and measure participation in welfare-to-work programs. The analysis in this 
section uses a fairly simple indicator, defining participation as "ever** having participated in the indicated activity 
within the 1 1 -month foil jw-up period. Registrants were counted as having ever participated in a GAIN activity if 
they attended at least cnce, rJthough most participants stayed much longer than this. This definition differs 
substantially from the one embodied in the federal regulations for the JOBS program. 

"The participation rate in basic education, as well as the overall participation rate, was lowest in Butte in part 
because that county delayed assigning orientation attcndcrs to case managers in order to limit the size of case 
managers' caseloads while still including as many people as possible in orientation and appraisal sessions. 
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similar to those of AFDC-FG registrants. The only notable difference was the higher proportion of 
AFDC-U registrants who participated in ESL - as many as 70 percent of AFDC-U participants (in Los 
Angeles, which served a high proportion of refugees). 

Other measures in Tables 3.2 and 3.3 show that many registrants were deregistered or deferred 
from the GAIN program at some point during the 11 -month follow-up period. For the AFDC-FGs, the 
deferral rate ranged from 28 percent in Butte to 68 percent in San Diego, while the deregistration rate 
ranged from 30 percent in Alameda to 80 percent in Riverside. As discussed above, these were the 
primary reasons registrants determined to need basic education did not participate in a basic education 
activity. 

The county GAIN programs differed in their use of the formal enforcement process - in 
particular, financial sanctions - as a method of securing registrants' compliance with the program's 
participation obligation.^^ Some believed that high compliance could be achieved without a heavy 
reliance on sanctions, and that efforts should be made to avoid imposing them except as a last resort. 
Others believed that sanctions are an essential tool for obtaining compliance and that, as long as the 
enforcement process is administered fairly, case managers should not take extraordinary steps to avoid 
using sanctions. Tables 3.2 and 3.3 show that Riverside used the conciliation process and resorted to 
sanctioning much more than any of the other research counties. Overall, 10 percent of the AFDC-FG 
registrants were referred for sanctioning in Riverside compared to zero to 6 percent in the other counties. 
Similar results were found for the AFDC-U registrants.^^ 

The counties also differed in the first activity registrants attended. In Alameda and Tulare, the 
first activity for registrants determined to need basic education was far more likely to be basic education 
(and far less likely to be job search) than was the case in Riverside. (See Figure 3.3.) This was also true 
m Butte and Los Angeles. In San Diego, the job search rate was higher than the county intended 
because, as discussed above, the supply of basic education slots early on was not adequate. This resulted 
in a waiting period during which some people slated for basic education were referred to job search. 

The policies and practices staff followed on a day-to-day basis also substantially influenced the 



In the GAIN program, there is an official multistep process for imposing penalties on registrants who fail to 
attend their assigned activity regularly. It begins with the registrant's being sent a Notice of Participation Problems 
outlining the sanctions that may be applied if the problems continue. This notice instructs the registrant to call or 
visit the case manager for a "cause detennination" meeting and warns that a failure to respond may affect the 
registrars welfare benefits. If no "good cause" is found to account for the participation problem, the next step 
is conciliation, where the case manager attempts to get the registrant to agree to begin participating as required. 
The final sten is financial sanctioning, whereby the registrant's welfare grant is reduced by eliminating her or his 
share of the grant until the registraiii cooperates. 

^"^For further explanation of the counties' formal enforcement policies, see Riccio and Friedlandcr, 1992. 
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FIGURE 3.3 



FIRST ACTIVITY FOR AFDC-FG EXPERIMENTALS 
DETERMINED TO NEED BASIC EDUCATION 
WHO STARTED ANY GAIN ACTIVITY 



Job Search 9.6% 




Job Search 12.5% 



Post-Assessment 4.8% 



SelMnitiated 

Education or Training 2.8% 




SelMnitiated 

Education or Training 15.0% 



Alameda 



Butte 



Job Search 12.6% 




Post-Assessment 0. 1% 
Self-initiated 

Education or Training 8.2% 



Los Angeles 



Job Search 25.7% 




Post-Assessment 1 .4% 



Self-initiated 
Education or 
Training 18.6% 



Job Search 30.2% 




Post-Assessment 4. 1% 



Self-initiated 
Education or 
Training 14.6% 



Riverside 



Job Search 5.7% 




Post-Acsessment 2.3% 
Seif-initiated 

Education or Training 3.4% 



San Diego 



Tulare 



SOURCE: MDRC's participant flow sample. 
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direction taken by the county programs." For example, staff in some counties told MDRC researchers 
that they tended to discourage registrants who entered job search from seeking very low-paying jobs or 
positions perceived as "dead-end" jobs, urging them instead to take full advantage of the education and 
training opportunities offered by GAIN. In other counties, the primary objective was to encourage 
immediate employment, with a lower priority being attached to the starting wage rate. 

GAIN staff responses to the MDRC Staff Activities and Attitudes Survey also demonstrate these 
different philosophies. To compare counties, a scale was constructed from items on the survey that 
measured each county's staffs emphasis on quick employment. The summary data for each county 
are presented in Figure 3.1b, where a higher score on the quick job entry scale is represented by a longer 
bar. Riverside clearly stands apart from the other counties on this dimension: Its staff placed much more 
emphasis on moving registrants into the labor market quickly than did the staff in any other county. 
Alameda and Butte had the lowest scores. Los Angeles, San Diego, and Tulare ranked in between, but 
closer to Alameda and Butte than to Riverside. 

In sum, several counties (particularly Alameda, Butte, Los Angeles, and Tulare) operated GAIN 
programs with both a higher proportion of registrants who participated in basic education activities and 
a program "message" that stressed these activities. Riverside was unique in the emphasis it placed on 
quick job entry and its relatively equal rates of participation in basic education and job search activities 
for those determined to need basic education. Along these dimensions, the GAIN program in San Diego 
fell in the middle range. 

IV, The Amount of Basic Education Received bv Participants 

The remainder of this chapter augments the previously published reports by examining in detail 
one group of GAIN registrants: those who attended a basic education activity at least once, a group 
referred to in this discussion as "basic education participants." This section reports on the number of 
months basic education participants attended these activities and the total number of hours they were 
scheduled to receive these services over a two- to three-year follow-up period. (Later sections discuss 
the actual number of hours participants attended their classes.) These measures are important from a 
policy perspective because they represent one way of gauging the "investment" made in human capital 
development. Defining the nature of this investment is crucial to understanding the payoff that can be 



^^Fora further discussion, sec Friedlandcr, Riccio, and Frcedman, 1993. 

^^For a description of the methodology that was used to create scales based on the staff survey, see Riccio and 
Friedlandcr, 1992, 
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expected from basic education. Economists speak of "opportunity costs/' meaning that doing one thinj 
costs a person the opportunity to do something else. Participants in basic education had two primary 
opportunity costs: some possible forgone earnings (because they could not be at work during the hours 
they spent in school) and time they could have spent in other activities such as working around the house. 
However^ opportunity costs can be recovered if the person^s investment in basic education has its intended 
payoff: increased earnings in the long run. Of course, length of participation in basic education also 
affects another kind of cost: the actual cost of the GAIN program. 

The information in this section is based on self-reported survey data from five counties: Alameda, 
Los Angeles, Riverside, San Diego, and Tulare (it was not possible to include Butte in the survey because 
resources for survey and test administration were limited). Sample sizes for AFDC-Us were not large 
enough to make possible reliable county-specific results. Thus, the results for this group were pooled, 
with all counties being weighted equally. AFDC-FG results are presented separately for individual 
counties and also pooled, again with all counties being weighted equally. 

The follow-up period for the survey ranged from two to three years within each county, averaging 
approximately 26 months in Riverside, San Diego, and Tulare, 30 months in Alameda, and 37 months 
in Los Angeles (see Appendix Table C.l). The findings are generally not sensitive to the different 
follow-up periods. Appendix Table C.l presents results using a uniform 24-month follow-up period. 

The use of survey data to measure length of stay introduces potential measurement biases that 
should be kept in mind when interpreting the data. First, survey data may underreport short education 
episodes if respondents forget short activities more readily than long ones; if so, the estimates will 
overstate average length of stay. To examine this potential bias, survey-reported length of stay was 
adjusted using some program tracking data.^^ It was calculated that the estimates of average length of 



^^In the GAIN evaluation, two sources of information about how long participants stayed in basic education are 
available: program tracking data and the registrant survey. Program tracking data (which were used for duration 
measures in previous MDRC reports on GAIN) followed sample members for only 11 months. Length-of-stay 
information is therefore truncated, and estimates of average length of stay among education participants will under- 
state the true duration of completed episodes of education. The analysis in this report relies primarily on survey 
data, which reflect a two- to three-year follow-up period. 

^^The adjusted length of stay was calculated as the weighted average of three components: the average length 
of stay computed from sample members reporting participation on the survey; the average length of stay for sample 
members with participation listed only in the program tracking data; and an imputed average length of stay for 
probable participation reported in neither the survey nor the program tracking data. To calculate average lengths 
of stay for the second and third components, the sample used consisted of cases that responded to the survey and 
for whom there were also program tracking data. For the second and third components, the average length of stay 
was assigned as the computed average (truncated) length of stay for cases with participation listed in the program 
tracking data but not reporting participation in the survey. It should be noted that the requisite data were available 
only for Riverside, San Diego, and Tulare. 
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stay among participants in basic education could be about 25 percent lower than the estimates obtained 
directly from the survey data and presented in this report. Second, as will be discussed, some individuals 
were still participating in basic education activities at the end of the two- to three-year follow-up period. 
This caused the average length of stay reported in the survey to be underestimated. These two biases 
worked in opposite directions. However, the overall bias could not be determined by the available data. 

This analysis examines only members of the experimental group who reported on the survey that 
they had attended a basic education activity for at least one day during the follow-up period. It begins 
by presenting the results for ABE and GED panicipants combined (the survey did not distinguish between 
these two types of education activities, and the results for both are reported as one measure). Then 
information about ESL participants is presented, followed by information for all types of basic education 
components combined (GED, ABE, and ESL).*^^ Finally, this section concludes with a discussion of 
the amount of basic education received by various subgroups of participants. 

A. Number of Months Attending ABE/GED Activities 

Table 3.4 shows the number of months ABE/GED participants reported that they attended the 
activity within the two- to three-year follow-up period. The first panel shows that participants attended 
for a substantial amount of time - an average of 8 months across all the counties. The number of 
months spent in these activities was longest in Los Angeles (1 1 months) and shortest in Riverside and San 
Diego by more than half as much (5 months). Alameda and Tulare fell in between at 9 months. The 
median number of months in ABE/GED was somewhat lower than the average, except in Riverside and 
San Diego. Overall, the average ABE/GED participant attended class for one school year. 

The distribution of the number of months in ABE/GED also reveals interesting patterns (see Table 
3.4). Approximately 60 percent of ABE/GED participants attended their education activities for 6 months 
or less, and 80 percent attended for one year or less. The results for Riverside and San Diego were more 
skewed: There 80 percent of the ABE/GED students stayed for less than 6 months. In sum, there was 
a fairly wide spread in the length of stay: Roughly 60 percent of the participants left their basic education 
activities within 6 months, and 20 percent stayed for longer than one year. 

This table also reports the proportion still participating in activities at the end of the follow-up 



^'Data on participation in education activities collected from the survey include participation in activities 
arranged through the GAIN program as well as participation in activities that registrants attended on their own 
initiative. 

^^Looking at the results using a uniform follow-up period of 24 months, one finds that the length of stay is 
approximately one month shorter in Alameda (8 months) and Los Angeles (10 months). The results in Riverside, 
San Diego, and Tulare do not change. Sec Appendix Table C.2. 
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TABLE 3.4 



FOR ABE/GED PARTICIPANTS: 
AVERAGE. MEDIAN. AND PERCENTAGE DISTRIBUTION OF NUMBER OF MONTHS IN ABE/GED 
WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD. 
BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Measure Alameda 


Los 
Mnysies 


niversiae 


ocin uieyo 


Tulare 


All 
f\\\ 

v^ouniies 


All 

AH 

Counties 


Average number of 
















months in ABE/GED 


8.5 


no 


0. 1 


0. 1 


O.I 


7 7 
1 .1 


o.y 


Median number of 
















months in ABE/GED 


6.4 




O.J 


^ i 

9.1 


1 .D 




K 7 


Percentage distribution 
















of number of months 
















in ABE/GED 
















Less than 2 months 


8.8 


lu.y 




oo. o 


lO.U 


<7 O 




2-6 months 


44.1 


23.9 


53.8 


57.1 


29.3 


41.7 


26.5 


7-12 months 


26.5 


34.8 


12.3 


12.5 


32.0 


23.6 


33.9 


13-18 months 


12.7 


8.7 


1.5 


5.4 


10.7 


7.8 


6.2 


19-24 months 


3.9 


17.4 


3.1 


1.8 


12.0 


7.6 


CO 


25-28 months 


2.0 


0.0 


1.5 


0.0 


0.0 


0.7 


5.1 


29 months or more 


2.0 


4.3 


0.0 


0.0 


0.0 


1.3 


0.0 


Percent participating in 
















ABE/GED at the end of 
















the follow-up period 


16.7 


17.4 


6.2 


16.1 


13.3 


13.9 


4.6 


Average number of months 
















on AFDC within a 2 -year 
















follow-up period 


23.0 


22.7 


17.6 


20.6 


20.9 


21.0 


20.5 


Sample size 


102 


46 


65 


56 


75 


344 


28 



SOURCE: MDRC calculations using data from the GAIN registrant survey and county AFDC records. 

NOTES: The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties. Butte 
County was not included In the GAIN survey. See Appendix Table C.1 for further information on the follow-up period in 
each county. 

This table contains estimates for sample members from the experimental group and includes participation in 
activities arranged through the GAIN program, as well as those that registrants participated In on their own initiative. 
The "all county** estimate is the average of the county estimates, with each county weighted equally. 
Distributions may not add to 100.0 percent because of rounding, 
(a) The AFDC-U sample does not include any registrants from Alameda. 
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period. Overall, roughly 14 percent were participating in ABE/GED at the end of the two- to three-year 
follow-up period. Most of these individuals were in the initial spell of their activity (meaning that they 
did not leave the activity and return at a later date),^^ although about one-quarter started in the initial 
spell in the second year of follow-up. 

It is important to note rhat the length of time spent on AFDC reflects the amount of time a 
registrant is "available" to participate in activities. Thus, to some extent, the county variation in the 
duration of education activities was influenced by the amount of time GAIN participants spent on AFDC 
in each county. The last row of Table 3.4 shows length of time on AFDC for basic education 
participants within a two-year follow-up period; this ranged from 18 months in Riverside to 23 months 
in Alameda and Los A.ngeles. (When interpreting these numbers, it should be remembered that 
registrants can leave the GAIN program and still remain on AFDC, or be temporarily deferred from 
participating in activities while remaining in the GAIN program.) Particularly in Alameda and Los 
Angeles, and consistent with their focus on serving long-term recipients, participants remained on AFDC 
for longer periods and attended their basic education activities for a greater amount of time. In contrast, 
in Riverside, the length of time on AFDC was shorter, as was the duration of basic education activities. 
However, the closeness of this measure across some of the counties suggests that other factors, such as 
the county implementation practices discussed earlier in this chapter, can also play a role in explaining 
the length of basic education activities. 

B. Total Scheduled Hours in ABE/GED Activities 

This discussion concerns the total number of hours of ABE/GED instruction basic education 
participants were scheduled for during ;he two- to three-year follow-up period. It is important to note 
two things. First, these estimates are not the total number of hours participants actually attended these 
classes. Rather, because participants may not have attended all their scheduled classes, these estimates 
represent an upper boundary of the number of hours they actually attended class. Data on actual hours 
of participation, obtained from school attendance records, are discussed later in this chapter, but are 
available for only a small sample of individuals from selected counties. Thus, the measures of scheduled 
hours are useful for comparative purposes (across counties and subgroups) and for establishing the 
maximum level of education received. 

Second, total scheduled hours reflect the maximum number of hours of basic education the 



Alameda and San Diego, a greater proportion (18 and 44 percent, respectively) of those still participating 
had left an initial basic education activity and then returned to another. 
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registrant could have received, given the number of weeks she or he reported attending class and the 
number of hours per week for which she or he reported the class to have been scheduled over the two- 
to three-year follow-up period (i.e., the total scheduled hours for each individual are the product of that 
person's average weekly scheduled hours and the number of weeks lhat person attended basic education 
classes). 

The first row of Table 3.5 shows the number of hours per week ABE/GED participants reported 
they were scheduled for their classes. On average, participants reported they were scheduled for basic 
education activities for roughly 20 hours per week. As noted above, Los Angeles and San Diego 
scheduled classes for more hours per week (roughly 25) than did the otiier counties (which averaged 
roughly 17 hours per week). 

As illustrated in the second row of Table 3.5, the average number of total scheduled hours in 
ABE/GED activities was large - 663 hours per AFDC-FG participant, on average. Los Angeles had 
almost twice as many total scheduled iiours (1,107) as the other counties, again partly reflecting the high 
proportion of long-term recipients served by that program. Riverside had the lowest number, with an 
average of 476 hours per participant.-^^ ^ is important to note that the total number of scheduled hours 
in San Diego was similar to that in Alameda and Tulare, even though the number of months in basic 
education activities was considerably smaller in San Diego (see Table 3,4). Because participants were 
scheduled for more hours per week in San Diego, they received a similar amount of services in a shorter 
time period. Across all counties, approximately one-half of the participants were scheduled to receive 
500 hours or fewer, and (except in Los Angeles) about 20 percent were scheduled for more than 1,000 
hours of ABE/GED. 

C. Number of Months Attended and Total Scheduled Hours for ESL Participants 

Table 3.6 shows the amount of basic education received - both the number of months attended 
and the total scheduled hours - for ESL participants. Because of small sample sizes, these measures 
were pooled across the counties (with all counties being weighted equally) for AFDC-FG and AFDC-U 
participants. 

In comparison to ABE/GED participants, ESL participants attended their activities for a longer 
time, averaging 10 months for AFDC-FG registrants across all the counties within the two- to three-year 



^^Total scheduled hours do not represent the amount of time the GAIN program scheduled participants for class. 

^^When the results are looked at using a uniform follow-up period of 24 months, the total scheduled hours in 
ABE/GED activities were somewhat shorter in Alameda (517 hours) and Los Angeles (994 hours). The results in 
Riverside, San Diego, and Tulare changed only slightly. See Appendix Table C.3. 
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TABLE 3.5 



FOR ABE/GED PARTICIPANTS: 
AVERAGE. MEDIAN. AND PERCENTAGE DISTRIBUTION OF TOTAL SCHEDULED HOURS IN ABE/GED 
WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD. 
BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Measure 




Los 








All 


All 


Alameda 


Angeles 


Riverside 


San Diego 


Tulare 


Counties 


Counties 


Average weekly 
















scheduled hours 
















in ABE/GED 


16.0 


25.0 


17.5 


24.3 


17.1 


20.0 


18.4 


Average total scheduled 
















hmirc in ARP/r^PD 

il%JUIS> III MPwv3C»L/ 


ODU. 1 


1 , lUO.D 


476.4 


545.0 


628.1 


663.3 


650.3 


Median total scheduled 
















hours in ABE/GED 


437.2 


1 ,090.7 


297.1 


543.3 


580.7 


528.6 


484.3 


Perce Jitage distribution 
















of total scheduled hours 
















in ABE/GED 
















Less than 100 hours 


11.8 


4.3 


27.7 


16.1 


6.7 


13.3 


29.5 


1 00-- 249 hours 


22.5 


6.5 


15.4 


10.7 


24.0 


15.8 


4.5 


250-499 hours 


16.7 


13.0 


33.8 


19.6 


16.0 


19.8 


18.6 


500-999 hours 


32.4 


21.7 


12.3 


42.9 


22.0 


28.3 


25.4 


1,000-1,499 hours 


9.8 


30.4 


3.1 


5.4 


13.3 


12.4 


16.9 


1,500 hours or more 


6.9 


23.9 


7.7 


5.4 


8.0 


10.4 


5.1 


Sample size 


102 


46 


65 


56 


75 


344 


28 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 
NOTES: See Table 3.4. 
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TABLE 3.6 



FOR ESL PARTICIPANTS: 
AVERAGE, MEDIAN, AND PERCENTAGE DISTRIBUTION OF NUMBER OF MONTHS 
AND TOTAL SCHEDULED HOURS IN ESL 
WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD, 
BY AFDC STATUS 



Measure AFDC-FGs AFDC -Us (a) 

Average number of 10.1 1 1 .2 
months in ESL 

Median number of months in ESL 7.5 10.7 

Percentage distribution of 

number of months in ESL 

Less than 2 months 4.9 0.0 

2-6 months 40.2 35.8 

7-12 months 31.7 26.7 

13-18 months 7.9 27.5 

19-24 months 7.6 2.5 

25-28 months 7.8 2.5 

29 months or more 0.0 5.0 

Percent participating in ESL at 

the end of the foliow-up period 26.9 1 2.5 
Average weekly scheduled 

hours in ESL 17.9 16.7 
Average total scheduled 

hours in ESL 774.0 885.8 
Median total scheduled 

hours in ESL 537.1 685.7 

Percentage distribution of 

total scheduled hours in ESL 

Less than 1 00 hours 6.1 1 2.5 

100-249 hours 21.3 0.0 

250-499 hours 22.4 23.3 

500 -9'99 hours 18.1 24.2 

1.000-1,499 hours 15.7 30.0 

1 ,500 hours or more 16.4 10.0 

Average number of months 
on AFDC within a 2~year 

foliow-up period 20.4 20.4 

Sample size 56 '16 

SOURCES AND NOTES: See Table 3.4. 
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follow-up period/"* In this time period, AFDC-FG participants were scheduled to receive 774 hours 
of ESL services. A significant portion - over one-quarter - were participating in ESL at the end of the 
follow-up period. Length of stay in ESL was spread somewhat more equally than in ABE/GED: Roughly 
75 percent of the AFDC-FG participants attended for one year or less. Approximately one-half were 
scheduled to receive 500 hours or iess of ESL, although 16 percent were scheduled for 1,500 hours. 
Overall, the length of time for GAIN registrants to learn English appears to have been substantial. 

A summary measure of the amount of basic education received by all types of basic education 
participants combined (GED, ABE, and ESL) is presented in Appendix Table C.5. As shown, across 
all types of basic education activities, participants attended for 8 months and were scheduled for 6*^2 
hours. The county variation followed patterns similar to those described above. 

D. Amount of Basic Education Received by Subgroups of Participants 

In order to understand the investment in basic education made by different types of GAIN 
registrants, the analysis in this subsection examines the number of months and total scheduled hours in 
oasic education for a set of subgroups defined by demographic characteristics collected when registrants 
entered the GAIN program. This is done in order to determine whether certain types of registrants were 
more likely to spend shorter or longer periods in basic education. While those at lower education levels 
were expected to stay longer, it is possible that this group was less motivated or interested in school, and 
thus more likely to leave the basic education activities relatively quickly. 

The educational achievement levels of participants are defined in several different ways: whether 
they scored 215 or above on the reading or mathematics CAS AS test (or on both tests), whether they 
had a high school diploma or a GED, and the highest grade they completed. Subgroups relating to the 



^"^Looking at the results for ESL participants using a uniform follow-up period of 24 months, one finds that the 
average number of montlis attended was approximately one month shorter (9 months) and that average total 
scheduled hours were reduced slightly (to 721 hours). See Appendix Table C.4. 

^^This is substantially more education than is typically received through the adult basic education system. A 
recent study, following a national random sample of adult education students over a one-year follow-up period, 
found that these students attended class for 4 months and received 80 hours of instruction on average (for GED, 
ABE, and ESL components combined). See Development Associates, 1993. However, the amount of basic 
education received by GAIN participants may be similar to that received in the Saturation Work Initiative Model 
(SWIM), a welfare-to-work program operating in San Diego County (prior to GAIN), where basic education was 
not the initial, but a later, activity in the program model. Unpublished data from the SWIM evaluation show that 
basic education participants in SWIM attended their activities for 7 months on average. See Friedlander and 
Hamilton, 1993, for the most recent findings from the SWIM evaluation. 

^^is report did not collect information on the interest or motivation levels of basic education participants. 

^^As discussed in Chapter 2, the CASAS reading and mathematics basic skills tests arc administered to 
registrants when they enter the GAIN program. The cutoff of 215 is used in the present analysis because it is one 
criterion used by the GAIN program to determine whether GAIN registrants need basic education. 
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economic status of the registrants are also examined. These include whether the registrant was an AFDC 
applicant, a short-term recipient (on AFDC for two years or less), or a long-term recipient (on AFDC 
for more than two years), and whether the registrant was employed in the prior year. An overall ranking 
of "disadvantagedness" was also created, and was defined as those who were lacking a high school 
diploma or a GED, were long-term recipients, and had no earnings in the prior year. Finally, subgroups 
based on the age of the registrant are also examined. 

The subgroup resuks on the number of months participants attended basic education and their 
average total scheduled hours in ABE/GED activities are presented in Table 3.7.^^ (Only the average 
number of months attended is discussed in the text, but similar patterns hold for the number of total 
scheduled hours.) Overall, the average number of months participants attended ABE/GED was longer 
for those at lower education and economic levels. Those who scored below 215 on the reading or 
mathematics CASAS test participated in ABE/GED for a significantly longer period than did those who 
scored higher (9 versus 7 months for reading and 8 versus 6 months for mathematics). Length of stay 
also increased with age: Those below 25 years of age participated for 5 months, whereas those over the 
age of 45 participated for almost 10 months. 

The summary measure of disadvantagedness (which incorporates employment and welfare history 
information) also indicates that length of stay was greatest for the "most disadvantaged." Length of stay 
was approximately 9 months for this group, compared to 6 months for those who were "less 
disadvantaged." In sum, it appears that those at lower education levels do stay longer in activities than 
those at higher levels. This suggests that low achievement is not necessarily a barrier to participating in 
basic education. Rather, it appears that because o/low educational achievement, this group participates 
in basic education activities for a longer period of time. In addition, because these more disadvantaged 
individuals tended to spend more time on AFDC, they may have been available to participate in activities 
for a longer period of time.'*^ 



^^The demographic characteristics of survey responders for selected subgroups (i.e., subgroups based on CASAS 
test scores and disadvantagedness criteria) are presented in Appendix Table C.6. This table indicates that those at 
lower literacy levels were more likely to be long-term AFDC recipients and not to have worked in the past two 
years. 

^^Sample sizes were too small to conduct this subgroup analysis for ESL participants, 
'^^e most disadvantaged group was on AFDC for 22 months within a two-year follow-up period. The less 
disadvantaged group was on AFDC for 20 months during the same period. 
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TABLE 3.7 



FOR AFDC-FG ABE/GED PARTICIPANTS: 
AVERAGE NUMBER OF MONTHS AND TOTAL SCHEDULED HOURS JN ABE/GED. 
BY SELECTED CHARACTERISTICS AT GAIN ORIENTATION 



Characteristic 
and Subgroup 


Percent 
of Sample 


Average Number 
of Months 
in ABE/GED 


Average Total 
Scheduled Hours 
in ABE/GED 


Score on CASAS reading lest 
225 or above 
215-224 
214 or below 


52.0 
20.6 
20.1 


7.2 * 

7.2 

9.1 


607.4 *** 

548.0 

851.2 


Score on CASAS math test 
215 or above 
214 or below 


29.4 
63.4 


5.9 *** 

8.0 


476.2 *** 
684.6 


Score on both CASAS tests 
21 5 or above on both 
214 or below on one 
214 or below on both 


28.5 
45.1 
19.2 


5.8 *** 

7.8 

9.0 


467.3 *** 

632.4 

842.6 


High School Diplonna or GED 
Yes 
No 


19.8 
80.2 


5.9 ** 
8.0 


569.8 
675.8 


Highest grade conrjpleted 
1 1 or above 
9 or 10 
8 or below 


47.7 
36.0 
16.3 


6.8 ** 

7.9 

9.7 


603.9 ** 

650.8 

848.3 


Aid status (a) 
Applicant 

Short-term recipient 
Long-term recipient 


7.3 
15.7 
77.0 


6.5 ** 

5.1 

8.0 


592.9 ** 

431.8 

685.0 


Summary measure of 
disadvantaged ness (b) 
Less disadvantaged 
Most disadvantaged 


54.7 
45.1 


6.8 *** 
8.7 


595.0 ** 
738.4 


Employed in prior year 
Yes 
No 


27.6 
72.1 


7.2 
7.9 


617.6 
676.6 


Age 
24 or under 
25-34 
35-44 
45 or over 


7.6 
49.7 
34.9 

7.8 


5.1 ^ 
7.6 
8.2 
9.6 


450.4 
642.0 
716.0 
765.1 



Sample size 344 



SOURCE: MDRC calculations using data from GAIN Intake forms and the registrant survey. 

NOTES: Sample characteristics were recorded on the intake form by GAIN staff at orientation and are 
based on answers from GAIN registrants. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across Alameda. 
Los Angeles, Riverside, San Diego, and Tulare counties. Butte County was not Included In the GAIN survey. 
See Appendix Table C.I for further Information on the foltow-up period in each county. 

This table contains estinrwites for sample numbers from the experimental group and includes 
participation in activities arranged through the GAIN program, as well as those that registrants participated in 
on their own Initiative. 



(continued) 



TABLE 3.7 (continued) 



The estimates presented are the average of the county estimates, with each county weighted 

equally. 

Distributions may not add to 100.0 percent because of rounding. A small proportion of 
individuals were missing CASAS test scores and are not included in the subgroups based on this variable. 
Finally, one case was lacking the identifying information necessary to calculate prior earnings. It is not 
Included in the analysis of the level of disadvantage or employment in prior year subgroups. 

An F test was applied to differences among subgroups within a characteristic. Statistical 
significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) Applicants are registrants who were applying for AFDC at the time of referral to GAIN 
orientation; they include reapplicants who may have had prior AFDC receipt. Short-term recipients had 
received AFDC for two years or less; long-term recipients had received AFDC for more than two years (the 
AFDC receipt may not have been continuous). 

(b) The "most disadvantaged" individuals are those who did not have a high school diploma or 
GEO, were long-term welfare recipients, and had no earnings in the prior year. The "less disadvantaged" 
category contains those who did not meet these criteria. 
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Attendance Patterns in Basic Education Activities 



Another important factor influencing the investment made in basic education by GAIN registrants 
was their attendance patterns in school - defined here as the amount of education participants actually 
received on a weekly basis (on average). Regular attendance in basic education activities is necessary 
if students are to learn the material and progress through the program at a reasonable rate. In addition, 
GAIN'S participation mandate required registrants to attend their assigned activities on a continuous basis 
until they left the GAIN program (or were deferred from participating) or be subject to financial 
sanctioning. As previous MDRC research has indicated, however, promoting regular attendance in GAIN 
basic education activities was challenging. GAIN students may have had unresolved problems or negative 
experiences in school that hindered their attendance."*^ This is different from the schools* experience 
with traditional basic education students, who usually volunteer for education services and thus may be 
likely to attend classes more consistently on their own initiative. 

Because the counties in this study recognized that consistent attendance patterns were unlikely to 
be achieved without intervention, they invested resources to monitor attendance and follow up on 
attendance problems. The rest of this section examines the procedures counties and schools used to 
monitor attendance and also presents average weekly attendance data for GAIN registrants. 

A. Attendance Monitoring Procedures 

As noted above, GAIN*s mandatory participation requirement necessitated the development of 
procedures to track the attendance and progress of GAIN participants in adult education. Schools were 
asked to maintain this information on GAIN students and to regularly communicate it to the welfare 
department. Four of the counties (Los Angeles, Riverside, San Diego, and Tulare) set up relatively 
structured and timely procedures for monitoring attendance and progress. In these counties, attendance 
data were usually collected by designated staff at the school on a daily basis and communicated to GAIN 
program staff at least twice per week. 

While these four counties had structured attendance monitoring procedures, two counties were 
particularly notable in the efforts they made to resolve attendance problems. Some San Diego case 
managers had caseloads that consisted only of individuals assigned to basic education activities. These 
case managers spent two or three days per week at schools to assist clients and resolve attendance 
problems. In addition, school staff at the Learning Centers in San Diego directly contacted students who 
were not present for class - usually on the day they were absent. In Tulare, the GAIN program 



"^^See Riccio et al., 1989, and Pauly, Long, and Martinson, 1992. 
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employed transition counselors, whose primary responsibility was to promote and achieve good attendance 
patterns for GAIN students. Tulare also had a uniform attendance and performance monitoring system 
for all schools, and some schools in the county called clients directly each day they did not attend, to see 
if they could assist in removing barriers or resolving problems. 

Riverside used a different approach for registrants with poor attendance during the period of this 
study. Registrants who were not attending regularly were sometimes "transferred" from a basic education 
activity to a job search activity. Thus, registrants with poor attendance were not strongly encouraged to 
improve their attendance; instead, they were urged to find jobs if they did not want to be in school. 
While this was not a standardized policy, it occurred much more extensively than in the other counties 
and was consistent with the county's overall emphasis on quick employment. 

Attendance monitoring appeared weaker in Alameda and Butte, where schools sent attendance 
information to GAIN staff on a less frequent basis (monthly). As discussed in previous MDRC reports, 
results from MDRC*s staff survey also confirm these findings. Eight questions in the staff survey were 
used to measure the timeliness of the monitoring information staff in each county obtained. The scale 
included several questions concerning the monitoring of basic education participants."*^ The results are 
presented in Figure 3.1c. (The greater the proportion of staff who answered "high" on this scale, the 
more timely was the monitoring information they received.) Riverside, San Diego, and Tulare had the 
highest scores - with 57 percent or more of the staff giving this rating - while Alameda and Butte were 
distinctly lower (with fewer than 20 percent giving the same response). 

B* Average Weekly Hours of Actual Attendance 

This subsection reports on the average weekly hours of attendance in basic education classes by 
GAIN registrants. It presents the hours they actually spent in the classroom according to school records, 
not the self-reported scheduled hours discussed above. Again, these data provide essential information 
on registrants* investment in basic education. 

The data wc-f': collected from school attendance records in all the counties except Alameda and 
Los Angeles. (See Chapter 2 for a further description of how these data were collected.) In Butte, data 
for ESL students were not available. In addition, no distinction was made between ABE and GED 
components in Butte*s school records. Therefore, statistics for these two components were combined and 
are presented as part of the GED component. Sample sizes for AFDC-Us were not large enough to make 



'^^See Riccio and Friedlander, 1992, for the survey questions used to construct the scale. 
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possible reliable county-specific results. Thus, results for this group were pooled, with all counties being 
weighted equally. 

The figures reported here represent the average hours attended per week over the entire time 
participants were enrolled in basic education activities during the 12-month follow-up period, including 
some one- to two-week periods when classes were not in session because of breaks or holidays."*-^ These 
data cover a period prior to the time the JOBS program instituted its participation requirements and "20- 
hour rule." As shown in Table 3.5, AFDC-FG registrants reported that their classes were scheduled for 
roughly 16 to 18 hours per week. Classes in Los Angeles and San Diego were scheduled for somewhat 
longer hours ~ about 24 per week. 

On average, across all types of basic education activities, participants attended their basic 
education classes roughly 10 hours per week (see Table 3.8). San Diego had the highest number of hours 
attended per week for participants in each type of basic education activity - averaging 16 hours per week 
- probably owing to a combination of its greater number of scheduled hours and close monitoring 
procedures. Weekly hours of attendance were lowest in Butte - 5 hours per week. This is most likely 
because of its relatively weak monitoring system. Tulare and Riverside had similar average attendance 
levels - approximately 10 hours per week. 

As also shown in Table 3.8, weekly hours attended were somewhat shorter for GED activities. 
In most counties, a majority of participants attended class fewer than 10 hours per week. However, in 
San Diego, more than 50 percent of the p. .licipants attended for more than 15 hours per week, on 
average. The county that came closest to this mark was Riverside, where 14 percent of the participants 
attended for more than 15 hours per week."^ 

Table 3.9 shows the average weekly hours of attendance in ABE and GED for the subgroups 
discussed above. Before examining weekly hours, it is important to look at the distribution of ABE 
and GED participants across subgroups. It is particularly interesting but not surprising to note that the 
bulk of GED participation was among the higher literacy subgroups. Sample members who scored below 
215 on both CAS AS tests accounted for less than 5 percent of the GED participants. Sample members 
who did not complete more than the eighth grade accounted for only about one-tenth of all GED 



"^^I-onger breaks, such as summer vacation, were not counted in calculating the average weekly hours of 
attendance. Because short breaks were included in the average weekly hours of attendance, they are slightly 
underestimated. 

**The previously cited study of a nationally representative sample of adult education students (Development 
Associates, 1993) found that GED students attended class 4.2 hours per week, ABE students attended 4.4 hours, 
and ESL students attended 5.9 hours. GAIN'S attendance was generally higher, as documented in this chapter. 

"^^Sample sizes for ESL participants were too small for presenting subgroup results. 
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TABLE 3.8 



FOR BASIC EDUCATION PARTICIPANTS: 
AVERAGE WEEKLY HOURS OF ACTUAL ATTENDANCE IN BASIC EDUCATION ACTIVITIES 
WITHIN 12 MONTHS OF GAIN ORIENTATION, 
BY AFDC STATUS AND COUNTY 



AFDC-FGs AFDC -Us 

All All 

Measure Butte (a) Riverside San Diego Tulare Countie s Counties 



Average weekly hours in 



GED 


5.2 


7.9 


14.3 


9.3 


9.2 *** 


9.4 


ABE 


n/a 


11.8 


16.7 


10.4 


13.0 *** 


15.2 


ESL 


n/a 


9.8 


16.8 


13.9 


13.5 *** 


12.7 


All basic education activities 


5.2 


9.8 


15.6 


10.4 


10.2 *** 


10.8 



Percentage distribution of 
v^eekly hours in all 
basic education activities 



Less than 5 hours 


54.2 


23.8 


7.7 


7.8 


23.4 *** 


25.4 


5-9 hours 


31.3 


35.7 


17.5 


44.9 


32.3 *** 


24.6 


10-14 hours 


12.5 


26.2 


23.3 


35.3 


24.3 *** 


26.7 


15-19 hours 


0.0 


7.1 


27.3 


7.2 


10.4 *** 


13.5 


20 hours or more 


2.1 


7.1 


24.2 


4.8 


9.5 *** 


9.8 



Sannple size (b) 

GED 48 34 249 84 415 82 
ABE n/a 33 356 74 463 120 
ESL n/a 18 108 26 152 77 
Total 48 84 662 167 961 261 



SOURCE: MDRC calculations using data fronn provider attendance records. 

NOTES: Provider attendance data were not collected in Alanneda and Los Angeles counties. 

This table contains estimates for a subsample of experimental who participated in a basic education activity 
arranged through the GAIN program. 

The "all county** estimate Is the average of the county estimates, with each county weighted equally. 

Distributions may not add to 100.0 percent because of rounding. 

For AFDC-FGs, a chi-square test or an F test was applied to differences among counties. Statistical 
significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) In Butte, data were not available for ESL participants, and the providers did not distinguish between ABE and 
GED activities; all participants in this county are included in the GED category. 

(b) Sample sizes for GED, ABE. and ESL do not sum to the total sample size because some participants 
attended more than one education component. 



TABLE 3.9 



FOR AFDC-FQ ABE/QED PARTICIPANTS: 
AVERAGE WEEKLY HOURS OF ACTUAL ATTENDANCE IN ABE AND GED. 
BY SELECTED CHARACTERISTICS AT GAIN ORIENTATION 





ABE Participants 


GED Participants 


Characteristic 
and Subgroup 


Percent 
of Sample 


Average 
Weekly 
Hours 


Percent 
of Sample 


Average 
Weekly 
Hours 


Score on CASAS reading test 
225 or above 
215-224 
214 or below 


43.0 
30.7 
19.7 


12.9 
12.6 
14.2 


78.3 
15.7 
3.1 


9.1 
9.5 
12.4 


Score on CASAS math test 
215 or above 
214 or below 


7.1 
86.2 


12.5 
13.1 


64.6 
32.5 


9.2 
9.6 


Score on both CASAS tests 
21 5 or above on both 
214 or below on one 
214 or below on both 


6.0 
68.7 
18.6 


12.0 
12.9 
14.0 


64.3 
29.9 
2.9 


9.1 
9.9 
12.0 


High school diploma or GED 
Yes 
No 


32.4 
67.6 


13.1 
12.9 


7.7 
92.3 


10.2 
9.2 


Highest grade completed 
1 1 or above 
9 or 10 
8 or below 


52.1 
28.9 
19.0 


12.2 
13.4 
13.3 


46.9 
40.7 
10.4 


9.1 
8.8 
10.8 


Aid status (a) 
Applicant 

Short-term recipient 
Long-term recipient 


24.8 
26.1 
49.0 


15.2 *** 

14.7 

11.8 


31.6 
23.6 
44.8 


8.0 * 

9.5 
9.6 


Summary measure of 
disadvantagedness (b) 
Less disadvantaged 
Most disadvantaged 


73.0 
26.8 


13.8 *** 
11.6 


70.6 
29.2 


9.3 
9.0 


Employed in prior year 
Yes 
No 


31.3 
68.5 


13.0 
12.9 


40.7 
59.0 


8.6 
9.4 


Age 
24 or under 
25-34 
35-44 
45 or over 


7.6 
53.3 
29.4 

9.7 


11.9 
12.2 
12.9 
17.5 


7.2 
61.4 
24.6 

6.7 


9.2 ♦* 

8.6 
10.0 
12.1 


Sample size 


463 




415 





SOURCE: MDRC calculations using data from GAIN intake forms and provider attendance records. 



NOTES: Sample c^laracterlstk:s were recorded on the Intake form by GAIN staff at orientation and are based on 
answers from GAIN registrants. 

This table contains estlnr^ates for a subsample of experlmentals who partk^ipated In a basic education 
activity arranged through the GAIN program. 

Provkjer attendance data were not collected in Alanneda and Los Angeles counties. In Butte, the 
providers did not distinguish between ABE and GED activities; all partk^ipants in this county are Included in the GED 
category. 

The estimates presented are the average of the county estimates, with each county weighted equally. 

(continued) 
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TABLE 3.9 (continued) 



Distributions may not add to 100.0 percent because of rounding. Also, a small proportion of Individuals 
were missing CASAS test scores and are not included in the subgroups based on this variable. Finally, two cases 
lacked the identifying infornnation necessary to calculate certain measures related to prior earnings. These cases 
are not Included in the analysis of subgroups based on level of disadvantage and employment in the prior year. 

An F test was applied to differences among subgroups within a characteristic. Statistical significance 
levels are indicated as *** = 1 percent; ** = 5 percent: * = 10 percent. 

(a) Applicants are registrants who were applying for AFDC at the time of referral to GAIN orientation; they 
include reapplicants who may have had prior AFDC receipt. Short-term recipients had received AFDC for two 
years or less; long-term recipients had received AFDC for more than two years (the AFDC receipt may not have 
been continuous). 

(b) The "most disadvantaged" individuals are those who did not have a high school diploma or GED. 
were long-term welfare recipients, and had no earnings in the prior year. The "less disadvantaged" category 
contains those who did not meet these criteria. 



participants. Both of these subgroups accounted for markedly greater proportions of ABE participants. 
The pattern is just the opposite for the highest literacy group. Those who scored 215 or more on both 
CASAS tests accounted for a large proportion of GED participants and only a small share of ABE parti- 
cipants. These patterns will help explain the impacts of GAIN on GED receipt, presented in Chapter 5. 

Table 3.9 is also useful for assessing which types of clients participated most intensively and at 
which groups efforts to improve attendance could usefully be directed. For both GED and ABE 
activities, younger registrants attended classes somewhat less consistently than did older registrants. 
Long-term recipients and the "most disadvantaged" attended ABE activities for slightly fewer hours than 
did applicants and short-term recipients and less disadvantaged registrants. For GED activities, there was 
not a consistent pattern of differences, although those with higher CASAS scores attended fewer hours 
per week then did those with lower scores. Overall, while some of the differences within subgroups were 
statistically significant, they were also small, indicating that there were not major differences in the 
number of hours participants in these subgroups attended class each week. In contrast to total scheduled 
hours in basic education activities, actual weekly attendance did not increase with the level of 
disad vantagedness . 

In San Diego, individual-level scheduled hours were available in addition to actual hours of 
participation. This made it possible to calculate an attendance rate (i.e., the proportion of scheduled 
hours participants actually attended). Table 3.10 illustrates the average scheduled hours of basic 
education activities each month, the average number of hours participants actually attended each month, 
and the attendance rate for each activity. Overall, basic education participants in San Diego attended 
approximately 63 percent of the time. Attendance rates were highest for ESL, with participants having 
attended almost three-quarters of their scheduled hours. For AFDC-FG registrants, the rates were 
somewhat lower for ABE and GED, ranging from 58 to 65 percent. The differences in attendance rates 
for AFDC-FG and AFDC-U basic education participants in San Diego were small. 

In other counties, data on individual-level scheduled hours were not collected from school records. 
Thus, a precise attendance rate cannot be calculated. However, in three counties where attendance data 
were collected, a "proxy" for the attendance rate can be calculated using provider data on actual weekly 
hours of attendance and GAIN survey data on weekly scheduled hours in basic education activities.'*^ 
It should be noted that these estimates are not exact because they combined data drawn for different 
subsamples and were derived from different data sources. They do, however, provide a useful 



Attendance data were not collected in Alameda or Los Angeles, and survey data were not collected in Butte. 
Therefore, these three counties were not included in this analysis, 
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TABLE 3.10 



FOR BASIC EDUCATION PARTICIPANTS IN SAN DIEGO: 
ATTENDANCE RATES IN BASIC EDUCATION ACTIVITIES. 
BY AFDC STATUS 



Activity and Measure 



AFDC-FGs 



AFDC ~ Us 



GED 

Average hours attended per week 
Average scheduled hours per week 
Attendance rate (%) 

ABE 

Average hours attended per week 
Average scheduled hours per week 
Attendance rate (%) 



13.6 
23.4 
58.4 



15.6 
24.0 
65.0 



15.0 
23.3 
64.2 



16.9 

25.0 
67.4 



ESL 

Average hours attended per week 
Average scheduled hours per week 
Attendance rate (%) 

All basic education activities 
Average hours attended per week 
Average scheduled hours per week 
Attendance rate (%) 



16.3 
22.5 
72.2 



14.7 
23.5 
62.7 



17.0 
22.7 
74.9 



16.4 
25.3 
64.8 



Sample size (a) 
GED 
ABE 
ESL 
Total 



209 
287 
92 
547 



57 
99 
49 

191 



SOURCE: MDRC calculations using data from San Diego's automated provider 
attendance records. 



NOTES: This table contains estimates for a subsample of experimentab who 
participated in a basic education activity arranged through the GAIN program. 

This table does not include 115 individuals in San Diego for whom 
attendance data were collected manually. 

(a) Sample sizes for GED. ABE. and ESL do not sum to the total sample 
size because some participants attended more than one education component. 



benchmark for assessing hours of attendance in relation to total scheduled hours. 

The first column of Table 3.11 shows the average weekly scheduled hours in basic education 
(GED, ABE, and ESL) based on responses to the GAIN survey (these data were presented earlier in this 
chapter; see Appendix Table C.5). The second column presents the average weekly hours actually 
attended based on provider records data (see Table 3.8). The third column shows the proportion of 
scheduled hours actually attended (by dividing actual hours of attendance by total scheduled hours). 

As shown, these attendance rates varied from 55 percent in Riverside to 65 percent in San Diego. 
The estimated attendance rate in San Diego was very similar to the rate calculated from San Diego's 
automated attendance data (see Table 3.10), suggesting that these estimates are useful benchmarks for 
determining the extent to which participants attend their classes. Interestingly, the estimated attendance 
rates were somewhat higher for San Diego, where monitoring procedures were more intensive and where 
greater service adaptations were made. 

Overall, these estimates indicate that GAIN participants attended their classes roughly 60 percent 
of the time, with a rate of 65 percent being attained by a program with relatively intensive monitoring 
procedures. This indicates that higher attendance rates may be difficult to obtain with this population. 
Program operators and administrators of mandatory basic education programs for welfare recipients 
should be aware that attendance rates in this range are likely, or could even be lower if structured 
monitoring procedures are not utilized. Given this result, it is also important to organize instruction so 
that it is still beneficial under these circumstances (i.e., so that students who miss some classes do not 
fall too far behind). 

These data also confirm that the average number of total scheduled hours of basic education 
services, presented earlier in this chapter, is an upper boundary of the amount of education received. 
Based on an attendance rate of 60 percent, total hours of basic education received (across all counties and 
all basic education activities) would average 403 hours, rather than the average total scheduled hours of 
672 (as reported in Appendix Table C.5). 

VI. Completing the Basic Education Component 

This chapter has shown that the vast majority of participants stay in basic education activities for 
less than one year, and that many leave with'.u six months. A key question to be answered is whether 
participants are completing their activities within this time frame, and what happens to participants after 
they leave basic education programs. These issues are discussed in this section. 
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TABLE 3.11 



FOR AFDC-FG BASIC EDUCATION PARTICIPANTS: 
ESTIMATED ATTENDANCE RATES IN BASIC EDUCATION, 
BY COUNTY 



County 


Average Weekly 
Scheduled Hours (a) 


Average Weekly 
Hours Attended (b) 


Estimated 
Attendance 
Rate {%) (c) 


Riverside 


17.7 


9.8 


55.4 


San Diego 


24.1 


15.6 


64.7 


Tulare 


17.4 


10.4 


59.8 



SOURCE: 
records. 



MDRC calculations using data from the GAIN registrant survey and provider attendance 



NOTES: Butte County was not included in the GAIN survey and could not be included in this analysis. 

Provider attendance data were not collected in Alameda and Los Angeles counties and could 
not be included in this analysis. 

This table contains estimates for sample members from the experimental group. 

Basic education includes GED, ABE, and ESL. 

(a) Based on survey responses. 

(b) Based on provider attendance records. 

(c) This estimate is calculated by dividing the second column by the first column. 
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A. State and County Policies on Completion 

At the time this study was conducted, the state provided only broad guidelines for determining 
when participants had completed education in GAIN. Only in the GED programs, where the program 
was completed when the registrant passed the GED test, were the completion standards specific/^ No 
similar guidelines existed for ABE and ESL courses. 

During the data collection period, the GAIN regulations stated that service providers could use 
their existing post-testing instruments and competency standards to judge a participant's successful 
completion. These policies were not, however, interpreted consistently at the local level. Thus, the 
criteria for judging progress and completion in ABE and ESL not only varied from county to county but 
also sometimes from school to school within counties. Subsequent to the period covered in this report, 
CDSS and CAS AS jointly addressed the problem of standardizing ABE completion criteria by developing 
an exit test for ABE students who have completed their course work. This exit test is now in place. In 
addition, counties varied in whether registrants who completed ABE went on to GED or were referred 
back to GAIN for job search services (the latter practice was consistent with the GAIN regulations). 

Los Angeles and San Diego were the only counties with standardized exit procedures for ABE and 
ESL, while Riverside had such standards for ABE/^ San Diego also had rules requiring registrants 
who completed ABE to enroll in a job search activity rather than attend a GED program. Although not 
a uniform policy, most of the other counties generally urged registrants to attend a GED program after 
completing ABE, an emphasis that was particularly strong in Tulare. In Riverside, a registrant had to 
show a strong interest in pursuing a GED program for it to be assigned after completion of an ABE 
course. 

B. Completion Rates 

This discussion considers how many registrants completed their basic education activities within 
a 12-month follow-up period. Although the follow-up period for this information is shorter than the two- 
to three-year period for the length of stay data, the data do reveal some interesting patterns. The analysis 
examines only registrants who participated in an education activity and is based on data from school 
records in four sites: Butte, Riverside, San Diego, and Tulare. (See Chapter 2 for a description of how 
these data were collected.) These data were not available in Alameda or Los Angeles. For Butte, data 
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^''Few of the basic education programs serving GAIN students were geared toward attainment of a high school 
diploma. 

^*Los Angeles and San Diego used exit tests developed by CASAS; students who scored 215 or above on the 
exit test "completed" the activity. Riverside required a score of 8.9 on the TABE test. 
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for ESL students were not available. In addition, no distinction was made between ABE and GED 
activities in Butte's school records. Therefore, statistics for these two components were combined and 
are presented under GED.'*^ 

Basic education participants were defined as having "completed" the activity when, according to 
their county's or provider's standards, they had reached the appropriate skills level. Participants were 
considered to have "exited" basic education when they left without completing the activity for reasons 
such as employment. Table 3.12 summarizes the results on completion patterns for the four counties 
within a one-year follow-up period. 

Overall, 21 percent of the AFDC-FG GED and ABE participants completed their program within 
the one-year foUow-up period. The completion rate for ESL activities was very low: 4 percent for the 
AFDC-FGs. The e rates were similar for AFDC-U participants. 

There were significant differences between counties in completion rates, however. San Diego had 
the highest completion rates, with close to 40 percent of the participants completing their A 3E or GED 
activities. As noted above, San Diego had standardized exit criteria for ABE in schools serving GAIN 
registrants. These concrete and uniform standards may have been a factor in achieving the county's 
completion rate, since participants were working toward a well-defined goal. Butte had the lowest 
completion rate for GED. This is partly attributable to the fact that, because there was a waiting list for 
being assigned a case manager, many registrants started education activities later in this county and thus 
were still participating in them at the end of the one-year follow-up period.^^ 

Consistent with the county practices described above, participants in Tulare who completed an 
ABB activity were much more likely to go on to a GED course than were participants in other counties. 
In Tulare, 35 percent of those who completed ABE went on to a GED program, while fewer than one 
percent did so in Riverside and San Diego (not shown in the table). 

Two other important findings are presented in Table 3.12. First, a large proportion of participants 
"exited" an activity without completing it. As noted previously in this chapter, this is primarily because 
participants were temporarily deferred or deregistered from GAIN for reasons such as employment or 
health problems - statuses consistent with the GAIN legislation (see Figure 3.2). In Riverside, more 
than 70 percent of the basic education participants exited without completing the program requirements. 



'^^This analysis relies on data collected for the provider attendance sample. The results presented here are 
slightly different from those presented in Figure 3.2 because that figure is based on results for a different sample 
(the participant flow sample). 

^°In addition, because the county providers' records did not distinguish between ABE and GED students, this 
sample may have included individuals whose skills levels were lower than those of the GED participants in other 
counties. 
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TABLE 3.12 



FOR BASIC EDUCATION PARTICIPANTS: 
COMPLETION STATUS WITHIN 12 MONTHS OF GAIN ORIENTATION. 
BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Activity and 
Status 



Butte (a) 

(%) 



Riverside 



San Diego 



Tulare 

(%) 



All Counties 

(%) 



AFDC-Us 
All Counties 

(%L 



GED 
Completed (b) 
Exited (c) 
Still active (d) 
Status unknown 



4.2 
20.8 
52.1 
22.9 



17.6 
70.6 
5.9 
5.9 



38.6 
49.4 
12.0 
0.0 



22.6 
41.7 
35.7 
0.0 



20.7 *** 
45.6 *** 
26.4 *** 

y 2 *** 



21.6 
48.4 
30.0 
0.0 



ABE 
Completed (b) 
Exited (c) 
Still active (d) 
Status unknown 



n/a 
n/a 
n/a 
n/a 



3.0 
75.8 
15.2 

6.1 



39.3 
51.7 
9.0 
0.0 



20.3 
58.1 
21.6 
0.0 



20.9 *** 
61.9 * 
15.3 ** 
2.0 *** 



20.7 
64.1 
15.2 
0.0 



ESL 
Completed (b) 
Exited (c) 
Sti! I active (d) 
Status unknown 



n/a 
n/a 
n/a 
n/a 



0.0 
66.7 
33.3 

0.0 



4.6 
53.7 
41.7 

0.0 



7.7 
53.8 
38.5 

0.0 



4.1 
58.1 
37.8 

0.0 



7.5 
48.6 
41.5 

2.4 



All basic education 

activities 
Completed (b) 
Exited (c) 
Still active (d) 
Status unknown 



4.2 

20.8 
52.1 
22.9 



8.3 
71.4 
15.5 

4.8 



36.3 
47.7 
16.0 
0.0 



15.0 
51.5 
33.5 
0.0 



15.9 *** 
47.9 *** 
29.3 *** 
6.9 *** 



16.7 
42.9 
39.4 
1.1 



Sample size (e) 
GED 
ABE 
ESL 
Total 



48 
n/a 
n/a 
48 



34 
33 
18 
84 



249 
356 
108 
662 



84 
74 

26 
167 



.415 
463 
152 
961 



82 
120 

77 
261 



SOURCE: MDRC calculations using data from provider attendance records. 

NOTES: Provider attendance data were not collected in Alameda and Los Angeles counties. 

This table contains estimates for a subsample of experimentals who participated in a basic education activity 
arranged through the GAIN program. 

The •*a!! county" estimate is the average of the county estimates, with each county weighted equally. 

Distributions may not add to 100.0 percent because of rounding. 

For AFDC-FGs, a chl-square test was applied to differences among counties. Statistical significance levels 
are irdicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) In Butte, data were not available for ESL participants, and the providers did not distinguish between ABE 
and GED activities; all participants In this county are included In the GED category. 

(b) "Completed" means that the participant reached the appropriate skill level according to county or provider 

standards. 

(c) "Exited" means that the participant left without completing the component because of employment, a 
transfer to a new component, or other reasons. 

(d) ''Still active** means that the participant was enrolled in the activity at the end of the follow-up period. 

(e) Sample sizes for GED, ABE, and ESL do not sum to the total sample size because some participants 
attended more than one education component. 
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In the other counties (except Butte), roughly 50 percent left their basic education activity without 
completing it. Except in Riverside, a higher rate of retention was achieved in GED activities than in 
ABE and ESL activities, which may be explained by the fact that participants and/or the county programs 
viewed GED attainment as being a more tangible and valued outcome. Second, a substantial portion of 
participants (averaging 29 percent for AFDC-FGs) were participating in their basic education activity at 
the end of the one-year follow-up period, so these completion and exit rates would have changed 
somewhat as participants continued to complete or leave their basic education activities. 

For the purpose of understanding how long it takes individuals to complete their activities, and 
how long participants attend before leaving their program. Table 3.13 examines the length of stay and 
actual hours of attendance for those who completed and exited their activities at the end of the 12-month 
follow-up period. Across all counties, those who completed GED activities did so within 3.5 months and 
after receiving roughly 149 hours of services. However, those who exited their activities did so in a 
shorter time, and generally attended their classes fewer hours per week, than did those who completed 
their activities. Since a substantial proportion of individuals were participating in activities at the end of 
the follow-up period, these estimates, too, should increase as those still in the activities complete or leave 
them. 

Figure 3.4 examines the month-by-month "status" of basic education participants over the 12- 
month follow-up period. Specifically, the figure illustrates the activity patterns of these participants over 
time as well as their status when they were not in basic education activities. The registrants included in 
this analysis were those who participated in a basic education activity within the 12-month follow-up 
period. For each month, sample members were counted in the status in which they spent most of their 
time that month. There are several things to note in this figure. First, the proportion of individuals in 
basic education remained relatively constant over time. One reason is that people started - and left - 
their basic education activities throughout the follow-up period. In other words, there was an ebb and 
flow into and out of basic education. Second, when basic education participants were not in classes, most 
of them were still in GAIN, but not actively participating, because they were deferred, involved in 
conciliation procedures, or waiting for an activity to start. The largest proportion of participants were 
in this status each month. Finally, more than 60 percent of the participants remained in the GAIN 
program at the end of the 12-month follow-up period. Roughly one-third of the participants deregistered 
from GAIN within the 12 months, and about one-half of those who were deregistered from GAIN were 
deregistered because they left AFDC. 
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VII. Summary 

All six research counties were able to offer basic education services to GAIN students, primarily 
by relying on the existing services in the community and in some cases by expanding them. Typically, 
GAIN students were offered the standard basic education programs available to other adult education 
students in the community, and few changes were made to the services previously provided. In San 
Diego, a major effort was made to redesign the services to the specific needs of GAIN students by 
integrating academics and life skills, by developing an entirely new network of Learning Centers (i.e., 
classrooms) that included up-to-date computer-based learning labs, and by hiring a new teaching staff. 
Across all counties, however, the basic education services appeared to offer students an "opportunity to 
learn" in that services used established curricula and instructional methods and were held for a substantial 
number of hours per week. 

A sizable portion (41 percent) of AFDC-FG registrants determined to need basic education actually 
participated in the activity. Almost all of the others were temporarily deferred or deregistered from 
GAIN for reasons such as employment or health problems, were referred to other activities such as job 
search, or were continuing in post-secondary education or vocational training activities they had begun 
prior to entering GAIN. Since these statuses are consistent with the GAIN legislation, substantially 
higher rates of participation in basic education would not have been feasible, especially in Alameda, Los 
Angeles, and Tulare. 

Those who participated in basic education activities did so for a substantial period of time ~ 
averaging about one school year (8 months for ABE/GED and 10 months for ESL, for AFDC-FG 
participants) within a two- to three-year follow-up period. Overall, roughly 60 percent of the basic 
education participants left their basic education programs within 6 months, while 17 percent stayed more 
than one year. 

There was notable variation by county. Length of stay in ABE/GED was shortest in Riverside 
and San Diego (5 months) and longest in Los Angeles (11 months). In Riverside, this appears to have 
reflected the county's philosophy of encouraging basic education participants who did not attend their 
classes consistently to seek employment rather than to continue in basic education. Length of stay in 
basic education activities was substantial in Alameda, Los Angeles, and Tulare. This was consistent with 
their emphasis on education activities and was also due, in part, to the somewhat more disadvantaged 
GAIN caseload in these counties, particularly in Alameda and Los Angeles. (More disadvantaged 
recipients tended to remain on welfare longer during the follow-up period.) Participants who had lower 
levels of literacy and longer welfare histories when they entered GAIN attended their basic education 
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programs longer than did the more advantaged groups - those with higher literacy levels and shorter 
histories of welfare receipt. 

Across the counties, participants were in the classroom for 10 hours per week on average. 
Weekly attendance was higher in San Diego, in part because classes were scheduled for more hours per 
week. Also, because the San Diego participants had more scheduled hours per week, they were enrolled 
for about as many total hours of basic education as were participants who averaged longer stays in basic 
education. Across the three counties for which data were available, basic education participants were in 
the classroom roughly 60 percent of their scheduled hours. San Diego, which had intensive monitoring 
procedures, achieved the highest rate of the three. In a mandatory basic education program for welfare 
recipients, such monitoring procedures may be required to achieve even these moderate rates of 
attendance. It is also important to organize instruction so that it is beneficial even when attendance is 
inconsistent - i.e., so that students who miss some classes are still able to profit from the program's 
instruction. 

Within a 12-month follow-up period, roughly 16 percent of basic education participants officially 
completed their basic education activities. Over the same time period, almost one-half left without 
completing them, primarily because they were deferred or deregistered from the GAIN program for 
reasons such as employment or health problems (statuses consistent with the GAIN legislation). The 
remainder were participating in the activity at the end of the follow-up period. Completion rates were 
highest in San Diego, where standardized exit criteria were used, and the rates for exiting were highest 
in Riverside. Those who did complete their basic education activities did so relatively quickly, usually 
within a four-month period. 
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CHAPTER 4 

GAINES IMPACTS ON PARTICIPATION IN BASIC EDUCATION AND OTHER SERVICES 



For the group of registrants determined to need basic education, the short-term goals of the GAIN 
program included increasing participation in basic education, job search, and other services in order to 
enhance their educational achievement and attainment, their employability, anu their long-term earnings. 
Chapter 3 described the GAIN treatment by presenting the experimental group's participation patterns 
in basic education activities. It showed that a substantial proportion of experimental participated in such 
activities and that some did so for relatively long periods. As will become evident below, however, some 
welfare recipients participated in education and training programs on their own initiative, without help 
from GAIN. This chapter describes what GAIN achieved in terms of participation in these services above 
and beyond what individuals would have done in the absence of the program. ^ 

This and the succeeding chapter rest on the random assignment research design described in 
Chapter 2 to estimate the difference the GAIN program made for those who were mandated to participate. 
To understand these differences (called program "impacts" or program "effects"), it is necessary to 
answer two basic questions. First, on average, what happened to those who were offered the GAIN 
program (i.e., the experimental group)? Second, on average, what would have happened to them had 
they not been offered the GAIN program (a condition represented by the experience of the control 
group)? The average impact of the program is the difference between the two groups in the many 
outcomes of interest. 

Comparing the participation patterns of experimentals to those of controls yields an estimate of 
the net effect of the GAIN program on participation in basic education and other activities. 
Understanding this net effect, and how it differed among the research counties and among different 
groups of welfare recipients, is important for understanding and interpreting GAIN'S impacts on 
educational achievement and attainment (presented in Chapter 5). 

This chapter presents the findings on the impacts of GAIN on the participation levels, length of 
stay, and total scheduled hours in basic education and in other employment-related activities. The 
measures include activities that were arranged through the GAIN program (for experimentals only) as 
well as those that sample members participated in on their own initiative. These measures are different 



'In the absence of the GAIN program, individuals who participate in education and training programs on their 
own would not have access to the support services (i.e., child care and transportation) provided by the program. 
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from those discussed in Chapter 3 in that results for both experimental and controls - and the difference 
between them - are presented. This chapter relies on data from a survey of GAIN registrants, which, 
as previously discussed, was administered approximately two to three years after random assignment. 
The survey was conducted in all of the research counties except Butte: Alameda, Los Angeles, Riverside, 
San Diego, and Tulare. The survey was conducted in these five counties for AFDC-FG registrants and, 
in all these counties except Alameda, for AFDC-U registrants. Because of small sample sizes, the results 
for AFDC-U registrants are presented only as an average across counties, with each county weighted 
equally. 

As noted in Chapters 2 and 3, the follow-up period for the survey varied somewhat among the 
five counties (see Appendix Table C. 1). However, the findings do not appear to have been sensitive to 
the county variation in the follow-up period. Selected results using a uniform follow-up period of 24 
months are presented in Appendix D. 

L A Comparison of Participation Rates Based on Proeram Tracking Data and Survey Data 

It is useful to begin this discussion with a comparison of the two sources of information available 
for estimating participation rates: program tracking and survey data. Participation rates computed from 
the GAIN registrant survey will, in general, differ from those presented in Chapter 3, which were 
computed from GAIN program tracking data. To some degree, the survey data will be more complete 
because participation questions were asked of both experimental and controls, and participation not 
known to the GAIN program could be reported, as could participation after the 11-month follow-up 
period of the program tracking data. However, survey-reported participation depends on the respondent's 
memory. Activities that occurred long before the survey interview (e.g., during the period immediately 
following random assignment) may have been forgotten. Activities in which the respondent spent only 
a short time might also have been forgotten. In contrast, the program tracking data were recorded at the 
time of participation, and researchers systematically verified each recorded instance of participation.^ 

Table 4.1 compares program tracking and survey-reported participation rates for AFDC-FGs, for 
each county and for all counties pooled and weighted equally. AFDC-Us are not included.^ The first 
row of the table gives the rate of participation in ABE or GED classes among experimental, using the 



^To be accepted as valid, participation recorded by GAIN staff had to be confirmed by a secondar>' source. 
For example, participation in ABE could be confirmed with an attendance report from a school. 

^ere were very few AFDC-Us for whom both program tracking and survey data were obtained. As discussed 
below, an overlap between the two data sources is needed for some of the adjustments in Table 4,1. 
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TABLE 4.1 



FOR AFDC-FGs DETERMINED TO NEED BASIC EDUCATION: 
PARTICIPATION ESIMATES FROM PROGRAM TRACKING AND REGISTRANT SURVEY DATA. 

BY COUNTY 



Outcome, Data Source, 
and Research Group 



Alameda Los Angeles 



Riverside San Diego 



Tulare All Counties 



Percent participating 
in ABE/GED 

Program tracking data 

Experimentals 

Controls, imputed (a) 

Difference 



52.7 
10.1 
42.6 



30.1 
5.8 
24.3 



25.2 
4.8 
20.3 



27.7 
5.3 
22.4 



45.9 
8.8 
37.1 



36.3 
7.0 
29.3 



Program tracking, data adjusted (b) 

Experimentals 64.7 

Controls, Imputed (a) 12.4 

Difference 52.3 



33.8 
6.5 
27.3 



30.5 
5.9 
24.6 



33.6 
6.5 
27.2 



55.6 
10.7 
44.9 



43.6 
8.4 
35.3 



Registrant survey data 
Experimentals 
Controls 
Difference 



45.3 
7.5 
37.8 



24.6 
4.5 
20.1 



16.8 
4.6 
12.2 



29.3 
6.9 
22.4 



34.7 
5.3 
29.4 



30.2 
5.8 
24.4 



Percent participating 
in job search 

Program tracking data 

Experimental 

Controls, imputed (a) 

Difference 



14.0 
2.2 
11.8 



8.8 
1.4 
7.4 



28.7 
4.5 
24.2 



22.6 
3.5 
19.1 



8.2 
1.3 
6.9 



16.5 
2.6 
13.9 



Registrant survey data 
Experimentals 
Controls 
Difference 



15.1 
3.3 
11.8 



7.0 
0.0 

7.0 



16.2 
0.5 
15.7 



23.6 
6.9 
16.7 



11.6 
0.9 
10.7 



14.7 
2.3 
12.4 



Sample sizes 

Program tracking data 
Experimentals 
Controls 



393 



2,430 



167 



137 



146 



3.273 



Registrant survey data 
Experimentals 
Controls 



225 
241 



187 

202 



388 
194 



191 
189 



216 
225 



1,207 
1.051 



SOURCE: MDRC calculations using data from the participant flow sample and the GAIN registrant survey. 

NOTES: Rounding may cause slight discrepancies In calculating sums and differences. 
Butte County vi/as not Included in the survey. 

(a) In the participant flow sample (for whom program tracking data were collected) , there are no controls. Therefore, 
rates of participation for controls are imputed by multiplying the experimental rate of participation based on program tracking data in 
each county by the all -county control/experimental ratio of participation rates for the survey. 

(b) Experimental group participation rates from the program tracking data were multiplied by an adjustment factor 
calculated using members of the sample determined to r^eed basic education who responded to the survey and for whom there 
were program tracking data as well. The factor was one plus the following ratio: the number of cases who reported participating in 
the survey but who were not listed as participants In the program tracking sample divkied by the total number of cases who 
reported participating in the survey. Separate factors were calculated for Alameda and Los Angeles. Owing to small samples, a 
single factor was calculated for Riverskle, San Diego, and Tulare combined. 
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program tracking data presented in Chapter 3/ Below this is an imputed control group participation rate 
for tho:e activities. Since control group data were absent from the program tracking data set, survey 
information was used to make this imputation.^ The experimental-control differences, shown in the next 
row, were determined mostly by the experimental participation rate; that is, the experimental-control dif- 
ferences were large or small across counties depending on whether the experimental group participation 
rate was high or low. 

The second set of entries in the table adjusts the program tracking participation rates for basic 
education activity reported in the survey but not picked up by GAIN staff. This adjustment increased the 
program tracking participation rates among experimental by about one-fifth;^ that is, information from 
survey respondents suggests that total participation in education may have been one-fifth more than was 
known to GAIN, although the increases varied across counties. Control group participation rates 
increased slightly because of this adjustment.^ The experimental-control differences increased slightly 
less than the experimental rates increased. Differences in the second set of entries are larger than those 
in the first set, but the two sets of estimates are very highly correlated; that is, the pattern of large and 
small differences across counties was virtually identical. 

The third set of table entries shows education participation rates for experimentals and controls, 
calculated from the survey only. These rates were almost always less than the program tracking partici- 
pation rates. In some cases, the difference was substantial, as in Tulare, where experimental survey 



*These rates measure participation in either ABE or GED and are therefore less than the sum of the separate 
participation rates for those activities. 

*It was assumed that the ratio of the control group participation rate to the experimental group participation rate 
was the same for survey and program tracking data. This ratio was calculated from the survey data for all counties 
combined and weighted equally. The ratio was then multiplied by each program tracking experimental group 
participation rate to impute the program tracking control group participation rate, applying the same ratio across 
all counties. 

^Experimental group participation rates from the program tracking data were multiplied by an adjustment factor 
calculated using members of the sample determined to need basic education who responded to the survey and for 
whom there were program tracking data as well. The factor was one plus the following ratio: the number of cases 
who reported participating in the survey but who were not listed as participants in the program tracking sample 
divided by the total number of cases who reported participating in the survey. Separate factors were calculated for 
Alameda and Los Angeles. Owing to small sample sizes, a single factor was calculated for Riverside, San Diego, 
and Tulare combined. Note tliat this adjustment procedure increased the program tracking participation rate for 
experimentals, even though the survey participation rate was less than the unadjusted program tracking participation 
rate. There Te other ways to adjust for underreporting of participation in the survey, and these will be explored 
in MDRC's final report on GAIN. 

"'As before, control group participation rates were imputed as the adjusted experimental rate multiplied by the 
survey-reported control: experimental ratio. Separate ratios were used for Alameda and Los Angeles; the unweighted 
average of ratios was used for Riverside, San Diego, and Tulare. 
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respondents reported 1 1 percentage points less education participation than did the program tracking 
sample of experimentals (34.7 percent for the survey versus 45.9 percent for the program tracking 
sample). The experimental-control differences calculated from the survey were also less than the 
differences calculated from the program track'ing data, whether adjusted or not. The patterns of 
experimental group levels and experimental-control differences were similar for program tracking and 
survey data, however. Across counties, the correlation coefficient between experimental group levels in 
the program tracking data and the survey data is +0.92 (out of a possible +1.00) for both unadjusted 
and adjusted estimates, and the correlations between experimental-control differences are -fO.94. 
Riverside had the smallest experimental level and experimental-control difference in both data sets. Los 
Angeles and San Diego had levels and differences in the middle range in both data sets. Alameda and 
Tulare had the highest levels and differences. The main differences in patterns between program tracking 
data and survey data were that Riverside's rates on the survey were further below those of the other 
counties and that San Diego was ranked somewhat higher on the survey.^ 

The table next shows participation rates for job search. As before, control group participation 
rates for program tracking data were imputed from survey information.^ Program tracking and survey 
data agreed quite closely. Experimental group participation rates and experimental-control differences 
were similar across the two data sets for most counties. Only Riverside showed marked differences: 
Rates and differences for Riverside were lower for the survey than for the program tracking data. It is 
likely that the program tracking data more accurately reflected true job search participation. That activity 
was short and often occurred near the date of random assignment. It may therefore have been forgotten 
by the time of the survey interview. It is unclear why Riverside should have been more prone to this 
kind of underreporting on the survey than the other counties. 

In summary, certain issues have been explored in comparing program tracking and survey 
participation data. For education, the survey data appear to adequately represent participation patterns, 
while understating the absolute level of participation. Job search rates on the survey are probably close 
to actual patterns and levels. The one exception is Riverside, where both basic education and job search 
participation are likely to have been more sever '(y underreported in the survey than elsewhere. These 
measurement issues should be kept in mind when interpreting the findings, especially those pertaining to 
Riverside. Finally, as discussed in the previous chapter, for length of stay among basic education partici- 



*When a regression line was plotted for experimental participation rates from the survey against experimental 
participation rates from program tracking data, Riverside was below the line and San Diego was above it. 
^e method of imputation was the same as for education participation. 
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pants, the survey had some advantages but may also have introduced biases leading to over- ov 
underestimates. 

IL GAINES Impacts on the Receipt of Services 

Table 4.2 displays the survey-reported percentage of experimental and controls who participated 
in various types of activities, as well as the difference between the rates (which is the impact of GAIN). 
As illustrated in the first section of the table, the use of ABE/GED activities by the control group was 
relatively low in all the counties: Overall, only 6 percent of the AFDC-FG registrants participated in these 
services on their own during the two- to three-year follow-up period. '° The experimental group's 
participation in ABE/GED varied from county to county, with a range of 17 to 45 percent. For all 
counties combined, GAIN produced a 24 percentage point impact on ABE/GED participation. This 
represented a large and statistically significant increase in the proportion of sample members who 
participated in basic education services. Compared to AFDC-FGs, somewhat fewer AFDC-U 
experimental participated in ABE/GED, but the impacts were statistically significant. 

Impacts on the receipt of ABE/GED services varied by county, ranging from 12 percentage points 
in Riverside to 38 percentage points in Alameda. The GAIN programs in Los Angeles, San Diego, and 
Tulare also had relatively substantial impacts on participation levels in ABE/GED, ranging from 20 to 
30 percentage points. These results are consistent with Riverside's relatively high emphasis on 
employment, and the focus on basic education activities in the other counties (see Chapter 3). The 
impacts of GAIN on the receipt of ESL services were small (2 percentage points), although they were 
statistically significant in Alameda and San Diego.** Overall, considering participation levels in all 
basic education activities combined, as shown in the third section of Table 4.2, GAIN produced an impact 
ranging from 1 1 percentage points in Riverside to 40 percentage points in Alameda. 

To understand the duration of the GAIN basic education treatment, it is also useful lo examine 
GAIN'S month-by -month impacts on participation levels in basic education activities over the follow-up 
period. Across all the counties, Figure 4.1 compares the proportion of experimental and controls who 
participated in ABE/GED each month after random assignment, using a uniform follow-up period of two 



'°As previously noted, the survey did not distinguish between ABE and GED services. 

"The use of ESL may be slightly underestimated owing to the sampling strategy for the survey, which included 
only Spanish and Vietnamese non-English speakers. Thus, individuals who spoke Laotian, Hmong, or Cantonese 
as well as other languages were not included. These individuals constituted a small proportion of the GAIN sample 
(under 5 percent). However, they are a group that would have been targeted for ESL services in GAIN, 
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TABLE 4.2 

FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S TWO- TO THREE-YEAR IMPACTS ON PARTICIPATION IN SELECTED ACTIVITIES, 

BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Outcome and 
Research Group 



Alameda 



Los 
Angeles 



Riverside San Diego 



Tulare 



All 

Counties 



AFDC-Us (a) 
All 

Counties 



Ever participated 
in ABE/GED 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated 
in ESL 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in any 
basic education activity 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in 
job search activities 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in 
vocational training 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in 

post-secondary 

education 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in 
work experience 

Experimentals (%) 

Controls (%) 

Difference 

Ever participated in 
any activity 

Experimentals (%) 

Controls (%) 

Difference 



45.3 
7.5 
37.8 *** 



2.7 
0.4 
2.3 



48.0 
7.9 
40.1 *** 



15.1 
3.3 
1 1 .8 *** 



10.2 
9.5 
0.7 



15.1 
14.1 

1.0 



4.0 
0.8 

3.2 ** 



67.6 
30.3 

37.3 *** 



24.6 
4.5 
20.1 *** 



9.6 
5.5 
4.1 



34.2 
9.9 
24.3 



7.0 
0.0 

7.0 *** 



7.5 
6.9 
0.6 



6.4 
4.5 
1.9 



0.5 
0.0 
0.5 



46,5 
20.3 

26.2 *** 



16.8 
4.6 

12.2 *** 



2.6 
3.6 
-1.0 



19.3 
8.3 
1 1 .0 *** 



16.2 
0.5 

15.7 *** 



10.3 
11.9 
-1.6 



11.9 
10.8 
1.1 



29.3 
6.9 
22.4 *** 



8.4 

4.2 
4.2 



35.6 
10.6 

25.0 *** 



23.6 
6.9 

16.7 *** 



13.1 
13.8 
-0.7 



34.7 
5.3 
29.4 



2.8 
2.7 
0.1 



37.0 
8.0 
29.0 *** 



11.6 
0.9 

10.7 *** 



0.5 
0.5 
0.0 



46.9 
31.4 
15.5 *** 



11.0 
9.0 
2.0 



3.7 

0.0 

3.7 *** 



60.2 
32.8 
27 4 *** 



6.0 
5.3 
0.7 



13.4 
10.7 
2.7 



3.7 

0.4 

3.3 ** 



53.2 
22.7 

30.5 *** 



30.2 
5.8 
24.4 *** 



5.2 
3.3 
1.9 ** 



34.8 
8.9 
25.9 *** 



14.7 
2.3 
1 2.4 *** 



9.4 
9.5 

-0.1 



11.6 
9.8 
1.7 



2.5 
0.4 
2.1 



54.9 
27.5 

27.4 *** 



20.3 
2.4 
17.9 *** 



9.8 
5.9 
3.9 



30.1 
8.2 
21.9 



15.7 
4.3 

^ ^ 4 *** 



4.7 
7.2 
-2.5 



5.6 
3.7 
1.9 



0.0 
0.0 
0.0 



45.4 
21.0 

24.4 *** 



Sample size 
Experinnentals 
Controls 



225 
241 



187 
202 



388 
194 



191 
189 



216 
225 



1.207 
1.051 



146 
147 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Calculations for this table used data for all survey responders, including those who did not participate in the activity. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties. Butte 
County was not included In the GAIN survey. See Appendix Table C.I for further infornnation on the follow-up period in each 
county. 

This table includes participation in activities arranged through the GAIN program, as well as those in which 
registrants participated on their own initiative. 

Tost-secondary education" Includes a small proportion of irxSividuals (roughly 10 percent of participants) who 
attended high school. 

Hounding may cause slight discrepancies in calculating sums and differerv^es. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 

A two-tailed t-test was applied to differences between experinriental and control groups. Statistical significance 
levels are Indicated as *** = 1 percent; 5 percent; * = 10 percent. 

(a) The AFDC-U sample does not include any registrants from Alameda. 
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FIGURE 4.1 

FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
MONTHLY PARTICIPATION IN ABE/GED, 
BY RESEARCH GROUP AND AFDC STATUS 



AFDC-FG Survey Respondents 
All Counties 




8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 

Months Since Random Assignment 



AFDC-U Survey Respondents 
All Counties 




8 9 10 11 12 13 14 15 16 17 13 19 20 21 22 23 24 

Months Since Random Assignment 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not Included In the GAIN survey. 
All counties are weighted equally. 



Experi mentals 
Controls 
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years. As shown in the figure, the percentage of controls in ABE/GED programs was very low and 
relatively constant over time, while the percentage of experimentals in these programs peaked at 16 
percent during the first three months and fell gradually over the follow-up period. As would be expected, 
the impacts were greatest during the first year of the program, and the service receipt differences declined 
toward the end of the follow-up period. The results for AFDC-Us were similar, although these 
registrants participated in ABE/GED activities at lower levels: The maximum participation rate for 
AFDC-U experimentals was 10 percent, a rate reached in the fifth month after the sample entered GAIN. 

Graphs presenting these data for each county individually, and for AFDC-FG registrants only, are 
presented in Appendix Figure D.l. The results reveal marked differences across the counties, reflecting 
their different implementation practices and the populations their GAIN programs served (as discussed 
in Chapters 2 and 3). The GAIN basic education treatment was relatively lengthy in Alameda, Los 
Angeles, and Tulare. Impacts on participation in ABE/GED in these counties peaked at close to or over 
20 percentage points during the first year, and were statistically significant over most of the uniform two- 
year follow-up period used in the figure. As shown in Appendix Table D.l, in some counties there was 
a small but statistically significant impact on the proportion of individuals who were participating in basic 
education activities at the end of the entire two- to three-year follow-up period: an impact of 6 percentage 
points in Alameda and 4 in Tulare. Thus, in these counties, GAIN'S impact on participation levels in 
ABE/GED activities had diminished, but not completely, by the end of the follow-up period for this 
report. If more experimentals than controls were participating in activities at the end of the follow-up 
period, it is possible that the program's full effects (on education, employment, or welfare outcomes) 
would not have been observed within this time frame. 

In Riverside and San Diego, the GAIN treatment was of shorter duration. The impacts on 
participation levels achieved in the first year were smaller and became not statistically significant in the 
first year of follow-up: by month 7 in Riverside and by month 11 in San Diego (see Appc; iix Figure 
D.l).»^ 

As discussed in Chapter 3, county variation in the duration of the basic education treatment was 
influenced by the different patterns of welfare receipt in each county. In Alameda and Los Angeles, 
which focused on serving long-term recipients, sample members tended to stay on welfare longer. 



'^The decline of impacts in San Diego was in part due to an increase in the level of service receipt for controls. 

•^For the experimental group, the average length of time on AFDC in each study county within the two-year 
follow-up period was: Alameda, 22 months; Los Angeles, 21 months; Riverside, 16 months; San Diego, 19 months; 
and Tulare, 19 months. 
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Thus, the length of participation in these activities could have been greater partly because sample 
members were available to participate in them for a longer period. In contrast, in Riverside both the 
length of time on AFDC and the length of the basic education treatment were shorter. Nonetheless, the 
length of time on AFDC did not vary as much among counties as did the duration of the activities. 
Therefore, it appears that other factors, such as county implementation practices discussed earlier in this 
report, may also play a role in explaining the duration of participation in basic education. 

GAIN also resulted in statistically significant impacts on the use of job search services across all 
the counties, as also shown in Table 4.2. Very few controls participated in these services, compared to 
7 to 24 percent of the experimentals, depending on the county. The impacts varied across counties, 
ranging from 7 percentage points in Los Angeles to roughly 16 percentage points in Riverside and San 
Diego. AFDC-FGs and AFDC-Us participated in job search activities at nearly equal rates. 

There also was a statistically significant but small increase (roughly 2 percentage points) in the 
use of work experience for AFDC-FG registrants. Work experience was most prevalent in Alameda, San 
Diego, and Tulare. No AFDC-U registrants reported that they had participated in work experience. 

For those determined to need basic education, GAIN did not produce impacts on the use of 
vocational training or post-secondary education within the two- to three-year follow-up period. 
Experimentals and controls participated in these activities at comparable and moderate rates. Across all 
counties, roughly one-tenth of the sample members participated in vocational training, and a similar 
proportion participated in post-secondary education. AFDC-U registrants participated in these activities 
at somewhat lower rates than did AFDC-FG registrants, although, again, there were no statistically 
significant differences between experimentals and controls. Thus, although vocational training and post- 
secondary education services were available through GAIN - primarily after the initial basic education, 
Job search, and assessment components — GAIN did not result in an increase in the proportion of welfare 
recipients who used these services within this follow-up period. 

The last section of Table 4.2 shows the i^npact of GAIN on overall service receipt (defined as 
participation in any activity). For AFDC-FGs in all counties, GAIN produced statistically significant and 
notable impacts on this measure. The proportion of experimentals who participated in services ranged 
from 47 percent in Los Angeles and Riverside to 68 percent in Alameda. A substantial number of control 
group members received services: approximately 20 to 30 percent, depending on the county. Thus, 
GAIN'S overall impact on service receipt ranged from 16 percent in Riverside to 37 percent in Alameda. 
Results for AFDC-Us were similar. 

In sum, GAIN substantially increased the proportion of experimentals who participated in basic 
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education and job search services, and produced small increases in the use of work experience. In all 
counties except Riverside, GAIN'S largest participation effect was on the receipt of basic education, and 
basic education was the most commonly used service. The impacts on participation in ABE/GED lasted 
relatively long in Alameda and Tulare. In those counties, a significant share of experimental were 
participating in ABE/GED during the second year of follow-up. For all counties, no impacts on the use 
of vocational training and post-secondary education were observed for the sample determined to need 
basic education during the follow-up period. 

III. GAINES Impacts on the Average Number of Months in Activities 

The previous section showed that GAIN increased the proportion of sample members who 
participated in basic education services. Another important question is whether GAIN produced impacts 
on the amount of services received. This analysis uses two measures of the amount of education 
received, and includes data for both experimental and controls. The measures are (1) the average 
number of months spent in basic education activities and (2) the average total scheduled hours in 
activities. It is important to remember that these average figures for the two groups include those who 
did not participate and, therefore, spent no time in the activity.''* The results presented in this section 
are particularly important for interpreting impacts on education and economic outcome measures, which 
also compare all experimentals with all controls. These are discussed in Chapter 5. 

Table 4.3 presents the impacts on the average number of months of participation in basic education 
and other employment-related activities over a two- to three-year follow-up period. As shown, GAIN 
produced statistically significant impacts on the number of months spent in education and job search 
activities. With regard to ABE/GED activities. Table 4.3 shows that, over the two- to three-year follow- 
up period, experimentals participated for 2.4 months in ABE/GED on average, while controls participated 
for an average of 0.4 months, for a statistically significant impact of 2.0 months. GAIN'S impacts were 
largest in Alameda and Tulare (about 3 months). Riverside and San Diego had impacts closer to one 
month, and the results were statistically significant. Los Angeles and San Diego also produced small, 
but statistically significant, impacts on the number of months spent in ESL.'^ 

Similar patterns are seen when results for all types of basic education activities are examined. 



'^Estimates of the length of time spent in education activities by participants only were presented in Chapter 3. 
'^These results do not change substantially when a uniform follow-up period of two years is used across all 
counties, as shown in Appendix Table D.2. 
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TABLE 4.3 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S TWO- TO THREE-YEAR IMPACTS ON THE AVERAGE NUMBER OF MONTHS IN SELECTED ACTIVITIES, 

BY AFDC STATUS AND COUNTY 



Outcome and 
Research Group 



AFDC-FGs 



Los 



Alameda Angeles Riverside San Diego 



Tulare 



All 

Counties 



AFDC -Us (a) 
All 

Counties 



Average number of 
months in ABE/GED 

Experimental 

Controls 

Difference 



3.8 
0.5 
3.4 



2.8 
0.6 
2.1 



0.9 
0.2 
0.6 



1.5 
0.3 

1 .2 *** 



3.0 
0.2 
2.8 



2.4 

0.4 
2.0 



1.4 
0.1 

1 .3 *** 



Average number of 
months in ESL 

Experimentals 

Controls 

Difference 



0.3 
0.1 
0.2 



1.1 
0.4 
0.7 



0.2 
0.2 
0.0 



0.5 
0.2 

0.3 



0.4 
0.2 

0.1 



0.5 
0.2 

0.3 *** 



1.3 
0.5 
0.8 



Average number of 
months in any basic 
education activity 

Experimentals 

Controls 

Difference 



4.2 
0.5 
3.6 



3.9 
1.0 
2.9 



1.1 
0.4 
0.7 



2.0 
0.5 

1.5 *** 



3.4 
0.5 

2.9 *** 



2.9 
0.6 
2.3 



2.7 
0.6 
2.1 



Average number of 
months in job search 
activities 

Experimentals 

Controls 

Difference 



0.2 
0.1 
0.1 



0.1 
0.0 
0.1 



0.3 
0.0 
0.3 



0.4 

0.1 
0.3 



0.2 

0.0 
0.2 



0.2 
0.0 

0.2 *** 



0.2 
0.0 
0.2 



Average number of 
months In vocational 
training 

Experimentals 

Controls 

Difference 



0.6 
0.5 
0.1 



0.5 
0.5 
0.1 



0.5 
0.5 
0.0 



0.5 

0.7 
-0.2 



0.3 

0.1 
0.2 



0.5 
0.5 
0.0 



0.3 
0.6 
-0.3 



Average number of 
months in post- 
secondary education 

Experimentals 

Controls 

Difference 



1.6 
1.2 
0.4 



1.0 
0.6 
0.3 



1.0 

1 .1 
-0.1 



1.1 

0.7 
0.4 



0.8 
0.6 
0.2 



1.1 

0.9 
0.2 



0.5 
0.3 
0.2 



Average number of 
months in work 
experience 

Experimentals 

Controls 

Difference 



0.2 
0.0 
0.2 



0.0 

0.0 
0.0 



0.0 
0.0 
0.0 



0.1 

0.0 
0.1 



0.1 
0.0 
0.1 



0.1 
0.0 
0.1 



0.0 
0.0 
0.0 



Sample size 
Experimentals 
Controls 



225 
241 



187 
202 



388 
194 



191 
189 



216 
225 



1.207 
1.051 



146 
147 



SOURCES AND NOTES: See Table 4.2. 
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GAIN produced an impact on the number of months attended that ranged from 0.7 months in Riverside 
to 3.6 months in Alameda. Again, the county variation in these results is partially explained by the 
different patterns of welfare receipt in each county. 

The impacts on the number of months in ABE/GED activities was primarily due to more 
experimentals having attended activities, rather than to experimental group members who participated in 
ABE/GED having attended those activities for a longer period of time than did control group members 
who participated in them (i.e., without the intervention of GAIN). Table 4.4 displays the calculations 
made to compute the number of months attended for each research group in each county. This indicates 
that, in Alameda and Tulare, experimentals who participated in ABE/GED stayed in those activities for 
longer than did controls who participated in ABE/GED; in Los Angeles, they did not stay as long. 
Nevertheless, the much larger proportion of experimentals who participated in ABE/GED accounted for 
most of the overall impact on the number of months attended. 

Table 4.3 indicates that GAIN produced statistically significant (but small) impacts on the average 
number of months in job search and work experience. Overall, GAIN did not produce impacts on the 
number of months in vocational training (except for a small impact in Tulare) or in post-secondary 
education. 

IV. GAINES Impacts on Total Scheduled Hours in Activities 

It is also important to measure GAIN'S impacts on the average number of total scheduled hours 
in activities, since this provides another gauge of GAIN'S effects on the amount of education (and other 
services) received by registrants. The GAIN survey collected information on the number of hours per 
week registrants reported they were scheduled for each activity they attended. As discussed in Chapter 
3, this was used to calculate the average number of hours experimentals and controls were scheduled for 
activities over the two- to three-year follow-up period (not the amount they actually attended). It is 
important to remember that these average figures for the two groups include those who did not participate 
and, therefore, spent no time in the activity.'^ 

As indicated in Table 4.5, the impacts on the total scheduled hours in basic education services 
received generally followed patterns similar to those described above for the length of stay in activities. 



'^Estimates of the average number of total scheduled hours in basic education activities for participants only 
were presented in Chapter 3. In addition. Chapter 3 provided information on the number of hours participants 
actually attended their activities. 
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TABLE 4.5 



GAIN'S TWO- TO THREE 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
-YEAR IMPACTS ON AVERAGE TOTAL SCHEDULED HOURS IN SELECTED ACTIVITIES 
BY AFDC STATUS AND COUNTY 









AFDC 


-FGs 






AFDC -Us (a) 


Outcome and 
Research Group 


Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


Ail 

Counties 


Average total scheduled 
hours in ABE/GED 

Experimentals 

Controls 

Difference 


253.9 
24.7 
229.2 *** 


272.2 
45.2 
227.0 *** 


79.8 
13.2 

66.6 *** 


159.8 
30.0 
129.8 *** 


218.1 
10.9 
207.2 *** 


196.8 
24.8 
172.0 *** 


149.6 
6.7 
142.9 *** 


Average total scheduled 
hours in ESL 

Experimentals 

Controls 

Difference 


22.3 
3.7 
18.6 


101 .8 
26.5 
75.3 ** 


15.5 
12.0 
3.5 


29.5 
12.3 
17.2 


28,4 
13.2 
15,2 


39.5 
13.5 

26.0 *** 


104.9 
36,8 
68,1 * 


Average total scheduled 
hours in any basic 
education activity 

Experimentals 

Controls 

Difference 


276.2 
28.4 
247.8 *** 


374.0 
71.7 
302.3 *** 


95.3 
25.2 

70.1 *** 


189.2 
42.3 

146.9 *** 


246.5 
24.2 
222.4 *** 


236,3 
38.4 
197.9 *** 


254.5 
43,4 
211,1 *** 


Average total scheduled 
hours in job search 
activities 

Experimentals 

Controls 

Difference 


14.6 
10.5 
4.1 


17.4 
0.0 

17.4 * 


19.3 
0.5 

18.8 *** 


40.1 
5.4 
34.7 *** 


12.8 
0.2 

12.6 *** 


20.8 
3,3 

17.5 *** 


17.5 
2.1 
15.4 ** 


Average total scheduled 
hours in vocational 
training 

Experimentals 

Controls 

Difference 


43.4 
50.6 
—7.2 


64.9 
39.6 
25.3 


48.0 
50.2 


55.9 
63.4 

—7 R 


35.4 
13.3 

C.C.. 1 


49.5 
43.4 

D. 1 


29.2 
74.2 

— *tO,U 


Average total scheduled 
hours in post -secondary 
education 

Experimentals 

Controls 

Difference 


116.9 
83.7 
33.2 


113.0 
46.5 
66.5 


73.1 
95.8 
-22.7 


73.8 
78.3 
-4.5 


63.5 
53.4 
10.1 


88.1 
71.5 
16.6 


36.6 
23.2 
13,4 


Sample size 
Experimentals 
Controls 


225 
241 


187 
202 


388 
194 


191 
189 


216 
225 


1.207 
1.051 


146 
147 



SOURCE: See Table 4.2. 



NOTES: See Table 4.2. 

Data on hours in work experience activities were not collected on the survey. 
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GAIN produced a statistically significant impact on the total scheduled hours of participation in 
ABE/GED in all counties, averaging roughly 172 hours across the counties. Again, the GAIN programs 
in Alameda, Los Angeles, and Tulare had the largest effect on total scheduled hours (over 200), while 
impacts for Riverside and San Diego were substantially lower (67 and 130 hours, respectively).*' 

The impacts of GAIN on total scheduled hours in ABE/GED programs were due mostly to more 
people attending rather than to higher weekly scheduled hours for activities. Appendix Table D.4 lists 
the weekly scheduled hours for basic education (and other activities) for experimentals and controls. This 
indicates that, particularly in Los Angeles and San Diego, experimentals who participated in basic 
education activities were, in fact, scheduled for more hours per week than were control group members. 
However, the much larger proportion of experimentals who participated in ABE/GED accounted for most 
of gain's impacts on total scheduled hours in basic education. 

The results for AFDC-U registrants were similar to those for AFDC-FG registrants, although the 
impacts on average number of months of participation and average total scheduled hours were somewhat 
less for ABE/GED and somewhat more for ESL.*^ 

V, Differences in Participation Levels and Amount of Education Received for Subgroups 

This section presents impacts on participation levels, average number of months of participation, 
and average total scheduled hours in ABE/GED for subgroups. Combining sample members from all 
counties, this subgroup analysis is intended to identify groups for whom the net effect of GAIN - in 



'■'These results do not change substantially when a uniform follow-up period of two years is used across all 
counties, as shown in Appendix Table D.3. 

'impacts on amount of basic education received have been estimated for other programs that have emphasized 
basic education services and that have been evaluated using an experimental design. Although exact comparisons 
with GAIN cannot be made because of differences in program design and populations served, these results provide 
useful benchmarks. Unpublished data from the evaluation of the SWIM program in San Diego - a mandatory 
welfare-to-work program that preceded GAIN and offered basic education as a later activity in the program model 
(after job search and work experience) - show that the program produced an impact of 0.5 months on the number 
of months of basic education received within a two- to three-year follow-up period. (The sample used in this analysis 
was a random cross section of the mandatory AFDC caseload and included welfare recipients determined to need 
or not need basic education). See Friedlander and Hamilton. 1993. for the most recent results from the SWIM 
evaluation. Findings from the JOBSTART Demonstration - a voluntary program that offered basic education, 
training, and other services to high school dropouts - produced impacts on total hours of education and training 
received of 370 hours within a two-year follow-up period. See Cave and Doolittle, 1991. Findings from the 
evaluation of Ohio's LEAP program, which offers financial incentives for teen mothers to stay in school or return 
to school, show that the program produced a statistically significant impact on the average number of months 
enrolled in high school or adult education, for teens who initially were not in school, of 1.3 months within a one- 
year follow-up period. See Bloom et al.. 1993. 

''Counties were weighted equally in the subgroup estimates. 
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terms of participation levels or length of time in basic education activities - was greatest. This is 
important to know because it is hoped that, in the long run, a payoff will be achieved for the groups in 
which GAIN made the largest investment. 

As discussed in Chapter 3, several of the subgroups studied for this report (including this section 
of the chapter) were defined according to their baseline (pre-GAIN) education levels: whether they scored 
215 or above on the CAS AS reading or mathematics test (or both), whether they had a high school 
diploma or a GED, and the highest grade they had completed. Subgroups relating to the economic status 
of the registrants are also examined. These include whether the registrant was an AFDC applicant, a 
short-term recipient (on AFDC for two years or less), or a long-term recipient (on AFDC for more than 
two years), and whether the registrant was employed in the prior year. The "most disadvantaged" 
registrants were defined as those who were lacking a high school diploma or a GED, were long-term 
recipients, and had no earnings in the prior year. Finally, subgroups based on the age of the registrant 
are examined. 

As Table 4.6 shows, GAIN'S impacts on levels of participation and amount of ABE/GED services 
received were statistically significant for all the subgroups analyzed. This means that GAIN had an effect 
on the amount of basic education received, above and beyond what welfare recipients would have done 
on their own, for important subgroups of the welfare population. 

There are, however, some important distinctions to be noted. For long-term AFDC recipients and 
applicants, GAIN'S impacts on participation levels in ABE/GED were 26 and 11 percentage points, 
respectively. Impacts on participation levels were also smaller for those who did not have a CAS AS 
score at baseline. This is because many of those without a CASAS score were non-English speakers, and 
were therefore unlikely to participate in ABE/GED. For those with no CASAS score, there was a 
statistically significant impact on the receipt of ESL services of 1 1 percentage points (not shown in the 
table). In addition, GAIN'S effects on participation were smaller for younger (under 25) and older (over 
45) welfare recipients. 

The amount of education received tended to be larger for those who scored below 215 on both 
CASAS tests or were long-term recipients. For example, the impacts for those who scored 215 or more 
on both CASAS tests were 2.2 months and 175 hours, compared to 3.0 months and 289 hours for those 
who scored below this level on both tests. Impacts on the amount of basic education received were also 
larger for those in the 25 to 44 age bracket (compared to both younger and older sample members). 

These findings indicate that GAIN was effective in inducing different subgroups of welfare 
recipients to participate in ABE/GED activities. Compared to what they would have done on their own. 
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GAIN had a greater effect on the amount of basic education received by the more disadvantaged segment 
of the caseload. In part, this is because more disadvantaged individuals tended to spend more time on 
AFDC and were available to participate in activities for a longer period of time. 

VI. Summary 

The data presented in this chapter indicate that GAIN produced large impacts on participation 
levels in basic education and job search but not in other activities. Impacts on participation rates in basic 
education activities persisted over most of the two- to three-year follow-up period, particularly in 
Alameda, Los Angeles, and Tulare (where overall impacts on participation levels were generally high). 
In Alameda and Tulare, the impacts on service receipt had mostly, but not completely, declined by the 
end ot the follow-up period. Reflecting both their implementation practices and the nature of the welfare 
caseload served, the duration of the GAIN treatment was longer in these counties than in Riverside and 
San Diego. • 

GAIN'S impacts on average number of months and total scheduled hours in ABE/GED were two 
months and 170 hours, respectively, and were largest in Alameda and Tulare. Most of these impacts 
were realized because more experimentals than controls attended activities, rather than because 
experimental who attended went for a longer period of time. Thus, GAIN*s primary effect was on 
increasing the number of welfare recipients who returned to school, rather than on the amount of time 
they stayed once they returned. 

Impacts on these measures were statistically significant for nearly all the subgroups that were 
examined The impacts on the amount of basic education received were larger for the more 
disadvantaged members of the sample: those with lower literacy levels and longer prior welfare receipt 
when they entered the research sample. Again, the more substantial impacts on participation and length 
of stay in Alameda and Los Angeles can, in part, be explained by the fact that these programs served only 
long-term recipients. 

These results suggest that GAIN achieved its key short-term objective of increasing the level of 
basic education services received by welfare recipients, above what they would have done on their own. 
In Alameda, Los Angeles, and Tulare, it appears that a relatively long investment in basic education 
services was being made and that a larger investment was being made by the more disadvantaged segment 
of this population. 
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CHAPTER 5 

GAINES IMPACTS ON EDUCATIONAL ATTAINMENT AND ACfflEVEMENT 



The previous chapter showed that GAIN led to increases in the amount of basic education the 
experimental group received. This chapter addresses the question of whether this increase translated into 
increases in the educational attainment and achievement of welfare recipients within a two- to three-year 
follow-up period. Section I presents GAIN'S impacts on educational attainment, as measured by receipt 
of a credential - specifically, a GED (or, in some cases, a high school diploma). Section 11 discusses 
GAIN'S impacts on educational achievement, as measured by literacy test scores. Section III concludes 
the chapter by examining the implications of these education outcomes for the employment, earnings, and 
welfare experiences of recipients.^ 

For the analyses in this chapter, it is important to differentiate between educational attainment and 
educational achievement. Educational attainment refers to receipt of a credential, which usually requires 
an individual tO pass an examination, course, or series of courses. Educational achievement refers to the 
academic skills level of an individual. To some extent, impacts on educational attainment and 
achievement could occur independently of each other. Some GAIN registrants might have to increase 
their achievement levels in order to learn the material necessary to obtain a credential; others may already 
possess the academic skills necessary to acquiring a credential and may only have to master the specific 
information needed to pass a certain course or examination. Alternatively, an education program may 
increase academic skills without necessarily leading to a particular credential. When interpreting the 
results in this chapter, the distinction between achievement and attainment should be kept in mind. 

L Impacts on Educational Attainment 

This section reports on GAIN^s impacts on educational attainment - specifically, receipt of a 
GED or a high school diploma. The data for this section were collected through the GAIN registrant 
survey, which was administered to both experimentals and controls two to three years after random 
assignment. To measure the educational attainment impacts of GAIN, post-random assignment receipt 
of a GED or a high school diploma for all experimentals was compared to that for all control group 



•This chapter does not include data on these issues beyond those presented in the previous report from the GAIN 
evaluation (Friedlander, Riccio, and Freedman, 1993). Additional information, based on longer follow-up, will be 
included in the evaluation's final report, scheduled for 1994. 
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members. This section begins by exploring the impacts on GED and high school dipioma receipt 
achieved by the GAIN study counties and then examines the impacts for subgroups of welfare recipients. 
It concludes with a discussion of the factors influencing the county results. 

A. Impacts on Receipt of a GED or a High School Diploma 

The majority of sample members who were determined by GAIN to need basic education lacked 
a G.^D or a high school diploma. For many of them, an important short-term objective of the GAIN 
program is to help them pass the GED test" or, in some cases, obtain a high school diploma. It is 
expected that attainment of this credential would, in turn, allow these individuals to compete more 
effectively in the labor market. 

There are three things to keep in mind when interpreting the magnitude of these impacts. First, 
as discussed in previous chapters, because of the nature of the GAIN program and welfare dynamics, only 
a portion of sample members participated in ABE or GED programs. Although not the only way to get 
a GED, participation in these kinds of programs makes it more likely that an individual will receive it. 
Second, even for those who did participate in a basic education program, acquiring a GED or a high 
school diploma was not always the goal (see Chapter 3). Some programs (particularly ABE programs) 
had other aims, such as learning enough basic reading and mathematics to achieve a specified score on 
a standardized test. Finally, some individuals who were determined to need basic education already had 
a GED or a high school diploma, so obtaining one of these credentials would not have been an 
appropriate goal; instead, GAIN usually sought improvement in their reading or mathematics performance 
(see Chapter 2). 

Information on receipt of a GED or a high school diploma during the two- to three-year follow-up 
period was obtained from the self-reports of GAIN survey respondents. Data were obtained for 2,551 
sample members, for an overall response rate of about 80 percent. An analysis of differences between 
respondents and nonrespondents may be found in Appendix A and shows that respondents received more 
AFDC prior to random assignment, were more likely to fall into the "most disadvantaged" category, and 
had other differences as well. These differences did not, however, appear likely to make educational 
attainment impacts estimated for survey respondents much different from impacts for the full sample of 
respondents plus nonrespondents. Among respondents, the only significant difference between 
experimentals and controls was in their distribution across counties. These county differences were 



^As discussed in Chapter 3, the GED test consists of five tests of high school performance in five areas: so- 
cial studies, literature, science, mathematics, and essay -writing. 
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expected, given the planned differences in ratios of experimentals to controls. The weighting procedure 
adopted in this chapter (and in earlier parts of this report) will correct for those county differences. Thus, 
comparing experimentals and controls should give unbiased, internally valid estimates of GAIN'S impacts 
on educational attainment. 

GAIN'S impacts on educational attainment within the two- lo three-year follow-up period are 
presented in Table 5.1. This table reports the percentage of sample members who were determined to 
need basic education who received a credential during the follow-up period (i.e., after random 
assignment). Impacts were measured by comparing all experimentals to all controls. Sample members 
who already possessed a GED or a high school diploma when they enrolled in the program were retained 
in the sample for this comparison, even though they were obviously not expected to have re-obtained this 
credential during the follow-up period.-^ Thus, in Table 5.1, sample members counted as not having 
received a credential include those who already had one before random assignment as well as those who 
did not have one and did not get one during follow-up. For those determined to need basic education, 
the proportion of AFDC-FG survey respondents who had a GED or a high school diploma at the time 
of random assignment was 16 percent in Tulare, 19 percent in Los Angeles and Riverside, 23 percent 
in San Diego, and 39 percent in Alameda."^ 

For AFDC-FG registrants in all five counties combined, there was a statistically significant impact 
on GED or high school diploma receipt of 7 percentage points within the two- to three-year follow-up 
period (see the second section of the table). This impact was almost entirely for receipt of a GED rather 
than a high school diploma: The impact on GED receipt alone was 6 percentage points. This was the 
case because most of the schools serving GAIN students geared their programs to receipt of a GED rather 
than a high school diploma. For AFDC-U registrants, the impact on receipt of a GED or a high school 
diploma was smaller (3 percentage points) but statistically significant. 

GAIN produced no impacts on receipt of trade certificates, associate's degrees, or bachelor's 
degrees overall or in any county. Given the low education levels of the group studied for this report, few 
registrants were successful in obtaining associate's or bachelor's degrees. Obtaining a trade certificate 
was more common (about 6 percent of the sample received one), but was about the same for 
experimentals and controls, i.e., GAIN did not increase receipt of trade certificates. 



^This was done lo make the base for these impacts comparable lo the base for the participation impacts. 
Across all five counties, 15 percent of the AFDC-U sample members had a GED or a high school diploma at 
the time of random assignment. These percentages were calculated from data reported on the GAIN intake forms. 
(See Appendix Table B.2.) As previously discussed, Butte was not included in the respondent survey or the TALS 
testing and was not part of the study of education outcomes. 
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TABLE 5.1 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON CREDENTIAL RECEIPT WITHIN A TWO- TO THREE-- YEAR FOLLOW-UP PERIOD. 

BY AFDC STATUS AND COUNTY 



Outcome and 
Research Group 



AFDC-FGs 



Alameda 



Received GEO during 
follow-up period 

Experlmentals (%) 

Controls (%) 

Difference 

Received GED or 
high school diploma 
during foliow-up period 

Experimentals (%) 

Controls (%) 

Difference 

Received GED or 
high school diploma, 
months 1 -6 

Experimentals (%) 

Controls (%) 

Difference 

Received GED or 
high school diploma, 
months 7~ 12 

Experimentals (%) 

Controls (%) 

Difference 

Received GED or 
high school diploma, 
months 13-24 

Experimentals (%) 

Controls (%) 

Difference 

Received trade certificate 
during follow-up period 

Experimentals (%) 

Controls (%) 

Difference 

Received associate's 
degree during 
follow-up period 

Experimentals (%) 

Controls (%) 

Difference 

Received bachelor's 
degree during 
follow-up period 

Experimentals (%) 

Controls (%) 

Differerxie 



Los 
Angeles 



Riverside San Diego 



Tulare 



All 

Counties 



_ AFDC -Us (a) 
All 

Counties 



Sample size 
Experimentals 
Controls 



O. f 


1 . 1 


5.4 


6.8 


16.2 


7.2 


2.9 


0.8 


0.0 


3.1 


1.6 


0,9 


1.3 


0.7 


5.9 *** 


1.1 


2.3 


5.2 ** 


15.3 *** 


6.0 *** 


2.2 




9 7 


6.2 


6.8 


20.8 


9.1 


3.8 


1.2 


0.5 


3.6 


2.7 


1.8 


2.0 


0.7 


J y *** 


2.2 * 


2.6 


4.1 * 


19.0 *** 


y ^ *** 


3.1 * 


4.0 


0,0 


2.3 


1.1 


8.3 


3.1 


1 .6 


0.0 


0.0 


2.1 


0.5 


0.4 


0.6 


0.0 


4 0 *** 


u.u 




0.6 


Y g *** 


2.5 *** 


1.6 


1.3 


0.0 


1.3 


3.1 


4.6 


2.1 


0.9 


0.4 


0.0 


0.0 


0.0 


0.4 


0.2 


0.0 


n Q 


0.0 


1.3 


3.1 ** 


4.2 *** 


1 .9 *** 


0.9 


2.7 


1,1 


1.8 


2.6 


6.9 


3.0 


1.4 


0.4 


0.0 


1.6 


1.6 


0.9 


0.9 


0.0 


o o ** 

C, .O 


1 .1 


0.2 


1.0 


6.0 *** 


2 -| *** 


1.4 


5.8 


3.2 


6.7 


7.3 


8.3 


6.3 


2.6 


5.4 


o r\ 
ii.U 




7 Q 


5,3 


5.6 


4.6 


0.4 


1.2 


-0.5 


-0.6 


3.0 


0.7 


-2.0 


0.0 


0.5 


0.3 


0.5 


0,0 


0.3 


0.0 


0.8 


0.5 


0.0 


0.5 


0,0 


0.4 


0.0 


-0.8 


0.0 


0.3 


0.0 


0.0 


-0.1 


0.0 


0.0 


0.5 


0.3 


0.0 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0,0 


0.0 


0.0 


0.0 


0.5 


0.3 


0.0 


0.0 


0.2 


0.0 


225 


187 


388 


191 


216 


1.207 


146 


241 


202 


194 


189 


225 


1,051 


147 



ERIC 



■109- 



1«5 



TABLE 5.1 (continued) 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Calculations for this table used data for all survey responders. including those who did not participate 
in basic education. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties. Butte 
County was not included in the GAIN survey. See Appendix Table C.1 for further information on the follow-up period in each 
county. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 
Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between experimental and control groups. Statistical significance 
levels are indicated as *** = 1 percent; = 5 percent; * = 10 percent. 

(a) The AFDC-U sample does not include any registrants from Alameda. 
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There was substantial county variation in GAIN'S impacts on educational attainment.^ Tulare 
achieved a striking impact on receipt of a GED or a high school diploma: a 19 percentage point 
differential between experimentals and controls. This was followed by an 8 percentage point impact in 
Alameda. Los Angeles and San Diego produced modest but statistically significant impacts on GED or 
high school diploma receipt - 2 and 4 percentage points, respectively.^ The GAIN program in 
Riverside, which had a relatively stronger focus on rapid employment than did the other counties, also 
produced only a small impact on GED or high school diploma receipt - under 3 percentage points and 
not statistically significant. Factors contributing to these county differences are discussed at the end of 
this section. 

As shown in Table 5.1, approximately one-third of the impacts on credential receipt occurred 
within the first six months after random assignment, but one-third also occurred during the second year 
of follow-up. Particularly in Alameda and Tulare, there were GED and high school diploma impacts well 
into the second year of follow-up. This suggests that welfare and employment impacts may not appear 
within that two-year follow-up period. When sample members are in school to obtain their GED or high 
school diploma, one might expect to see them not working or working less. 

B. Impacts on GED and High School Diploma Receipt for Subgroups 

This subsection presents subgroup impact estimates for GED and high school diploma receipt. 
Combining sample members from all counties,^ this analysis is intended to identify groups that obtained 
relatively large or small impacts on GED or high school diploma receipt. 



^Variation in credential receipt impacts across counties was statistically significant at the .01 level. 

^One anomaly in the survey data is worth mentioning. In San Diego, about 7 percentage points more 
experimentals than controls said they had a high school diploma or a GED prior to entering GAIN, according to 
the registrant survey. This pre-random assignment difference was not counted as part of the attainment impacts 
given in Table 5.1. Moreover, a different data source, the baseline data collected from sample members prior to 
random assignment, showed only a small pre-program difference in the percentage with a diploma or a GED. The 
pre-random assignment difference obtained from the survey may have been the result of recall error among 
respondents. 

^It is also interesting to examine thv itent to which GED or high school diploma receipt was associated with 
participation in ABE/GED programs. It is important to be aware that the analysis presented in this note is a 
nonexperimental analysis, not an impact pjialysis. It examines GED receipt for members of the experimental group 
who participated in a basic education program and does not compare experimentals and controls. 

Overall, not all of those who received a GED or a high school diploma after random assignment panicipated 
in an ABE/GED program. For the experimental group, 31 percent of those who received a GED or a high school 
diploma reported that they had not participated in an ABE/GED program. This indicates that panicipation in basic 
education programs is not necessary to attaining these credentials. Some registrants appear to have obtained such 
a credential on their own, perhaps through a home study course or by taking the GED test without formal 
preparation. 

*^Counties were weighted equally in the subgroup estimates. 
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As discussed in Chapters 3 and 4, several of the subgroups studied for this report were defined 
using the baseline (pre-GAIN) education levels of recipients: whether they scored 215 or above on the 
CAS AS reading or mathematics test (or both) and the highest grade they had completed. Subgroups 
relating to the economic status of the registrants were also examined. The criteria included whether the 
registrant was an AFDC applicant, short-term recipient (receiving AFDC for two years or less), or long- 
term recipient (receiving AFDC for more than two years), and whether the registrant was employed in 
the prior year. A category of "most disadvantaged" was also created and was defined as encompassing 
registrants who were lacking a high school diploma or a GED, were long-term recipients, and had no 
earnings in the prior year. Finally, subgroups based on the age of the registrant were examined. 

The impacts on educational attainment for subgroups, along with the impacts on total scheduled 
hours in ABE/GED for the same subgroups (repeated from Table 4.6), are presented in Table 5.2.^ As 
explained in Chapter 4, the impact on total scheduled hours in basic education is the difference between 
average scheduled hours for all experimentals in a subgroup and average scheduled hours for all controls 
in the same subgroup. The averages include members from both groups who did not participate and 
therefore spent no time in the activity (they are counted as zero in the averages). 

This table shows that GAIN'S impacts on GED and high school diploma receipt were highly 
concentrated in the subgroup of individuals at higher initial literacy levels. Specifically, those scoring 
215 or above on both the reading and mathematics CAS AS tests had a 20 percentage point impact on 
receipt of a GED or a high school diploma. Those scoring 215 or above on only one of these tests 
had only a 5 percentage point impact. Sample members scoring below 215 on both CAS AS tests and 
those having no CASAS test results (primarily because they could not read English) had no impacts on 
credential receipt. Large impacts were found for those who scored 215 or above on the CASAS 
mathematics test. Impacts were concentrated among those scoring highest (225 or above) on the CASAS 
reading test. For the subgroups defined by highest grade completed in school, impacts on GED and high 
school diploma receipt were found only for sample members who had previously completed some high 



^The demographic characteristics of survey responders for selected subgroups (based on CASAS test scores 
and for the most and less disadvantaged groups) are presented in Appendix Table C.6. This table indicates that 
those at lower literacy levels were more likely to be long-term AFDC recipients and not to have worked in the 
prior two years. 

^^Individuals who scored 215 or above on both CASAS tests were determined to need basic education because 
they met another GAIN criterion: lack of a GED or a high school diploma (i.e., at the time of random assignment), 
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TABLE 5.2 



FOR AFDC-FGs DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON CREDENTIAL RECEIPT WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD. 
BY SELECTED CHARACTERISTICS AT THE TIME OF RANDOM ASSIGNMENT 



Characteristic 
and Subgroup 



Percent 
of Sample 



Impact on Total 
Scheduled Hours 
in ABE/GED 



Percent Who Received 
GEO or High School Diploma 
During Folbw-up Period 



Experlmentals 



Controls 



Difference 



Score on CASAS 
reading test 

225 or above 

215-224 

214 or below 

No score 



46.1 
18.1 
15.4 
20.4 



183.6 
188.4 
288.5 
90.3 



17.1 
3.9 
1.4 
1.0 



3.5 
0.9 
0.0 
0.5 



XXX 

13.6 *** 
3.0 * 
1.4 
0.5 



Score on CASAS 

math test 
215 or above 
214 or below 
No score 



23.3 
56.2 
20.4 



174.9 
215.0 
90.3 



24.0 
5.1 
1.0 



5.2 
0.9 
0.5 



XXX 
18.8 
4.2 
0.5 



*** 
*** 



Score on both 

CASAS tests 
21 5 or above on both 
214 or below on one 
214 or below on both 
No score 



22.4 
42.8 
14.4 

20.4 



177.4 
182.7 
288.9 
90.3 



25.2 
6.3 
1.5 
1.0 



5.4 
1.2 
0.0 
0.5 



XXX 

19.7 *** 
5.2 *** 
1.5 
0.5 



Highest grade completed 

11 or above 48.5 

9-10 27.1 

8 or below 23.8 



161.5 
233.6 
147.9 



10.4 
1 ? 0 
1.7 



2.7 
1.7 
0.6 



XXX 
7.7 



1 1 .3 *** 



1.1 



Aid status (a) 
Applicant 

Short-term recipient 
Long-term recipient 



11.5 
17.0 
71.5 



70.7 
111.7 
187.5 



9.6 

12.3 
9.1 



3.8 
4.4 
1.4 



5.9 * 
7.9 *** 

y y *** 



Summary measure of 
disadvantaged ness (b) 
Less disadvantaged 
Most disadvantaged 



58.4 
41.2 



161.8 
206.9 



7.4 

11.8 



2.1 
1.7 



XX 

5.3 *** 
10.1 *** 



Employed in prior year 
Yes 
No 



30.7 
68.9 



153.2 
179.7 



8.6 
9.4 



3.0 
1.5 



5.6 *** 
7.9 *** 



Age 
24 or under 
25-34 
35-44 
45 or over 



8.1 
42.5 
33.5 
15.9 



36.8 
174.0 
226.3 
105.8 



6.2 
12.7 
7.7 

2.2 



6.7 
2.9 
0.3 
0.0 



XXX 
-0.6 
9.8 *** 

y 4 *** 

2.2 ** 



Sample size (total = 2.258) 



1.207 



1.051 



SOURCE: MDRC calculations using data from GAIN intake forms and the GAIN registrant survey. 

NOTES: Sample characteristics were recorded on the intake form by GAIN staff at orientation, and are based on 
answers from GAIN registrants. 

Calculations for this table used data for all survey responders. including those who did not 
participate in basic education. 

(continued) 
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TABLE 5.2 (continued) 



The follow-up period for the survey ranged from 26 to 37 months, on average, across Alameda, Los 
Angeles, Riverside, San Diego, and Tulare counties. Butte County was not included in the GAIN survey. See Appendix 
Table C.1 for further information on the follow-up period in each county. 

All counties are weighted equally in the subgroup estimates. 

A small proportion of cases are missing data on prior-year employment or highest grade completed. 
These cases are not included in the relevant subgroups. "Percent of sample" figures for these subgroups therefore will 
not sum to 100.0 percent. 

Rounding may cause slight discrepancies in calculating sums and differences. 

Sample members are missing CASAS test scores primarily because they were not proficient in English. 

A two-tailed t-test was applied to differerx:es between experimental and control groups. 
Statistical significance levels are indicated as = 1 percent; = 5 percent; ♦ = 10 percent. 

An F test was applied to differences among subgroups for each characteristic. Statistical significance levels 
are indicated as xxx = 1 percent: xx = 5 percent: x = 10 percent. 

(a) Applicants are registrants who were applying for AFDC at the time of referral to GAIN orientation; they 
include reapplicants who may have had prior AFDC receipt. Short-term recipients had received AFDC for two years 
or less; long-term recipients had received AFDC for more than two years (the AFDC receipt may not have been 
continuous). 

(b) The "most disadvantaged" indfviduals are those who did not have a high school diploma or GED, were 
long-term welfare recipients, and had no earnings in the prior year. The "less disadvantaged" category contains those 
who did not meet these criteria. 
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school, whether an earlier grade (9 or 10) or a later grade (11 or above). The subgroup that had 
completed only grade 8 or below had no attainment impact. 

The attainment impacts were more uniform for some other subgroups. Impacts were 5 percentage 
points or greater, and statistically significant, for AFDC applicants, short-term recipients, and long-term 
recipients; for those who had worked in the prior year and for those who had not; and for both the less 
and most disadvantaged groups. Within this cluster of subgroups, there was some tendency for sample 
members with shorter AFDC histories or better recent work records to have smaller impacts, especially 
the "less disadvantaged" subgroup. Impacts were priTnarily found for sample members between the ages 
of 25 and 44. For those under the age of 25, a significant number of control group members (7 percent) 
obtained a GED or a high school diploma on their own during follow-up, and GAIN did not produce 
results beyond this level. 

Table 5.2 also shows that the impacts on total scheduled hours in ABE/GED were not especially 
large for the subgroups who experienced the largest educational attainment impacts. Indeed, the 
subgroups that scored 215 or above on either or both CAS AS tests were scheduled for fewer total hours 
of education than those that scored below 215 on both CASAS tests. This indicates that differences in 
participation in basic education were not driving the subgroup impacts on receipt of a high school diploma 
or a GED. In other words, it cannot be said that the lower literacy subgroup failed to obtain impacts on 
credential receipt because they did not receive as much additional education as the higher literacy 
subgroups. 

In summary, the GAIN program produced impacts on receipt of a GED or a high school diploma 
mainly for those at higher initial literacy levels. These sample members achieved their relatively large 
impacts with smaller investments in amount of education received than those made by subgroups at lower 



''There are two reasons why the impacts were somewhat smaller for those who had completed grade 11 or 
above, compared to those who had completed only grade 9 or 10. First, a greater proportion of those who had 
completed grade 1 1 or above had a high school diploma or a GED at baseline: 44 percent of this group had such 
a credential at random assignment compared to 3 percent of those who had completed only grade 9 or 10. Impacts 
for these two subgroups are similar when only those who had no GED or high school diploma at random assignment 
are examined. (Impacts for other subgroups in Table 5.2 do not change notably when this subsample is used.) 
Second, the literacy levels (i.e., at random assignment) of those who had completed grade 1 1 or above were lower 
than those of sample members who had completed only grade 9 or 10. Some 22 percent of those who had 
completed grade 1 1 or above scored 215 or above on both CASAS tests, compared to 33 percent of those who had 
completed grade 9 or 10. Thus, for this sample, highest grade completed may not be a strong indicator of academic 
ability. 

*^The primary exception was those who did not have a CASAS score at baseline. Impacts on both participation 
levels and attainment were small for this subgroup. This is because many of those without a CASAS score were 
not proficient in English and were therefore unlikely to participate in ABE/GED or to receive a GED. 
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initial literacy levels. The higher literacy groups may have had (or were very close to having) the 
academic skills needed to obtain a GED or a high school diploma, despite having dropped out of school. 
The GAIN program appears to have provided an accessible route for acquiring the specific knowledge 
needed to pass the GED test. The program may also have provided the necessary support services (such 
as child care), the moral support, or the "push" these individuals needed to obtain their credential. 

C. Explaining County Differences in Impacts on Educational Attainment 

When examining the county differences in GED and high school diploma impacts, it is useful to 
consider two factors. The first is the extent to which the county GAIN programs were successful in 
obtaining credentials for those at different initial literacy levels. As shown in Table 5.3, all counties 
generally produced positive effects on GED or high school diploma receipt for those at higher literacy 
levels (although the results were not statistically significant in all counties). Alameda and Tulare stand 
out in the magnitude of their impacts for this group, with impacts of 29 and 40 percentage points, 
respectively. These two counties were also effective (though not as effective) in producing GED impacts 
for those who scored below 215 on one of the CASAS tests. As discussed in Chapter 3, the programs 
in these two counties placed a greater proportion of individuals in basic education services, encouraged 
individuals to move from ABE to GED activities, and provided a substantial amount of basic education 
to participants. These program features may have contributed to the relatively greater attainment impacts 
in these counties. 

A second factor that affected the county programs' impacts on GED and high school diploma 
receipt was the educational need of the caseload served by each county, particularly the proportion of the 
caseload whose CASAS scores placed them at the higher or lower levels. As noted in Chapter 2, Los 
Angeles served a very disadvantaged population. Only 9 percent of those determined to need basic 
education scored 215 or above on both CASAS tests, and one-third were non-English speakers. Los 
Angeles did achieve statistically significant GED and high school diploma impacts for those who scored 
225 or above on the CASAS reading test (see Table 5.3). But since this was a small proportion of the 
entire Los Angeles sample, the effects for that sample were small. Because Los Angeles served a larger 
proportion of welfare recipients for whom attaining a credential might have been more difficult or might 
have taken longer than the follow-up period covered in this report, smaller impacts might have been 
expected there than in the other counties. 



*^For a distribution of t^e CASAS baseline reading and mathematics scores for the survey respondent sample 
in each county (i.e., the sample analyzed in this section), sec Appendix Table B.2. 
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TABLE 5.3 



FOR AFDC-FGs DETERMINED TO NEED BASIC EDUCATIOiM: 
GAIN'S IMPACTS ON CREDENTIAL RECEIPT WITHIN A TWO- TO THREE-YEAR FOLLOW-UP PERIOD. 
BY LITERACY LEVELS AT THE TIME OF RANDOM ASSIGNMENT AND BY COUNTY 



Impact on Percent Who Received QED or High School Diploma 
During Foltow-up Period 



Test and 




Los 








Literacy Level 


Alameda 


Angeles 


Riverside 


San Diego 


Tulare 


Score on CASAS reading test 




XXX 






XXX 


225 or above 


12.0 *** 


10.6 ** 


4.8 


10.0 ** 


30.4 *** 


215-224 


4.0 


0.0 


-1.2 


0.0 


12.1 ** 


214 or below 


O./ 




u.u 


u.u 




No score 


0.0 


0.0 


— U.o 


U.U 




Score on CASAS math test 


XXX 






XX 


XXX 


215 or above 


28.3 *** 


7.1 


6.8 


14.7 * 


37.1 *** 


214 or below 


4.0 ** 


3.6 


1.2 


1.0 


1 1 .3 *** 


No score 


0.0 


0.0 


-0.3 


0.0 


2.9 


Score on both CASAS tests 


XXX 


X 




XX 


XXX 


215 or above on both 


28.5 *** 


8.3 


7.1 


14.7 * 


40.1 *** 


214 or below on one 


4.1 ** 


5.9 


1.5 


1.5 


12.8 *** 


214 or below on both 


3.8 


0.0 


0.0 


0.0 


3.9 


No score 


0.0 


0.0 


-0.3 


0.0 


2.9 


Sample size 












Experimentals 


225 


187 


388 


191 


216 


Controls 


241 


202 


194 


189 


225 



SOURCE: MDRC calculations using data from GAIN intake forms and the GAIN registrant survey. 



NOTES: Sample characteristics were recorded on the intake form by GAIN staff at orientation, and are based on 
answers from GAIN registrants. 

Calculations for this table used data for ail survey responders, including those who did not 
participate in basic education. 

The follow-up period for the survey ranged from 26 to 37 months, on average, across the five counties. 
Butte County was not included in the GAIN survey. See Appendix Table C.I for further information on the follow-up 
period in each county. 

A two-tailed t-test was applied to differences between experimental and control groups. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

An F test was applied to differences among subgroups for each literacy level. Statistical significance levels 
are indicated as xxx = 1 percent; xx = 5 percent; x = 10 percent. 
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The GAIN populations in Alameda and San Diego were at somewhat higher initial literacy levels: 
17 and 25 percent scored 215 or above on both CASAS tests, respectively. Unlike Alameda, and 
consistent with the GAIN regulations, San Diego did not assign many registrants who completed ABE 
to GED programs. Those in ABE programs in San Diego completed the basic education program when 
they received a score of at least 215 on the CASAS reading and mathematics tests, at which point they 
were usually referred to a job search activity, not to GED classes. This may have contributed to the lack 
of GED impacts for those at lower initial literacy levels in San Diego. 

Tulare also had a larger-than-average proportion of registrants (28 percent) scoring 215 or above 
on both CASAS tests. However, as shown in Table 5,3, Tulare was more successful in achieving GED 
impacts for this group than were the other counties. This may indicate that the package of education- 
related services offered in Tulare - the GAIN program's emphasis on education, the counseling and close 
monitoring GAIN provided, and the education services offered by the education providers - contributed 
to the large attainment impacts in Tulare. 

Riverside had the largest proportion of sample members who scored 215 or above on both CASAS 
tests (31 percent), but it did not produce statistically significant impacts on credential receipt for this 
group. This result may have been due to Riverside's emphasizing quick employment more than 
completion of basic education activities. 

In sum, the differences across counties in impacts on GED and high school diploma receipt are 
associated with differences in baseline literacy levels, but were primarily due to differences in the 
effectiveness of the county GAIN programs for individuals at different initial levels of literacy. Tulare's 
very high impacts were partly attributable to its having had a relatively large proportion of GAIN 
registrants at initially higher literacy levels. However, Tulare and Alameda were both distinguished by 
the greater success they had for both higher and lower literacy subgroups. 

II. Impacts on Educational Achievement 

Educational attainment, as measured by receipt of a GED or a high school diploma, is not the only 
measure of success in basic education programs. Some GAIN registrants could have acquired the basic 
skills generally needed to participate in the labor force without receiving such a credential. Moreover, 
a central goal of the GAIN program is to provide individuals with the human capital they need to get and 
hold jobs, which includes mastery of basic reading and mathematics skills. This section examines 
achievement gains resulting from the GAIN program, as measured by a basic skills test. 
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The basic skills tests used in the analysis are the document literacy and quantitative literacy 
sections of the Test of Applied Literacy Skills (TALS), which was developed by the Educational Testing 
Service (ETS).^'* Both experimentals and controls took the tests approximately two to three years after 
random assignment as the last part of the survey interview. As already noted, the tests were administered 
in all of the research counties except Butte: Alameda, Los Angeles, Riverside, San Die^o. and Tulare. 
AFDC-U registrants were not included in the TALS testing. 

A. Interpretation of the TALS and TALS Scores 

The TALS attempts to measure individuals' skills in understanding and using printed and written 
information needed to manage everyday life. This definition of literacy implies a set of information- 
processing skills that go beyond the decoding and comprehension of texts used in some other standardized 
tests. The TALS was designed to measure skills needed outside purely academic settings, i.e., skills 
required for effective functioning in the workplace and in a complex technological society. 

The two sections of the TALS used in the GAIN evaluation were designed to measure somewhat 
different literacy skills. The document literacy test, as its name implies, was designed to measure skills 
needed to work with documents. This test requires readers to use schedules, charts, graphs, maps, and 
forms. Performance on this test reflects knowledge associated with finding and transferring information 
given in one document to another. For example, one test item asks the respondent to read a line graph 
of car prices and to determine when the cost of a car was at its highest. 

On the quantitative literacy test, a respondent must read text and perfom arithmetic operations 
such as addition, subtraction, multiplication, or division, either singly or in combination, using numbers 
or quantities that are embedded in printed information. For example, an item in this test asks for the 
daily wage to be calculated from a want ad listing an hourly wage. 

The tests are not multiple choice; they require the test-taker to write in the answer. In scoring, 
the number of correct items is converted into a scale score that ranges from 0 to 500. ETS intends TALS 
scale scores to be interpreted as reflecting five literacy levels. It is not possible or appropriate to translate 
these test scores into grade-level equivalents. 

A description of the literacy skills associated with each of the five literacy levels is provided in 
Table 5.4 (for document literacy) and Table 5.5 (for quantitative literacy). Individuals estimated to be 



'"^There are three sections of the TALS, focusing on three different types of literacy: document literacy, prose 
literacy, and quantitative literacy. The prose literacy test was not used in the present study. For detailed 
information about the TALS, see Kirsch, Jungeblut, and Campbell, 1992, and Kirsch and Jungeblut, 1992. 
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TABLE 5.4 



DESCRIPTION OF UTERACY LEVELS ON TALS DOCUMENT TEST 



Level and Score Range 


Description of Tasks 
Required by Test Items (a) 


Examples of Test Tasks (b) 


Level 1 
0-225 


Tasks at this level are the least demanding. 
They typically require the reader to make a 
literal match between a single piece of 
information stated in a question and 
information provided in text, or to enter 
information from personal knowledge. 


Enter account information on a bank's 
savings withdrawal form. (200) 


Level 2 
<2d-27o 


Tasks at this level also Involve a single 
piece of information; however, several 
plausible choices for matching that are not 
correct may be presented. Also, the match 
may not be literal and may require drawing 
inferences from the text. 


Using a line graph of car prices, determine 
when the price of a particular car peaked. 
(268) 


Level 3 


Tasks require the matching of more than 
TWO pieces or inTormafiion. i ne inromriaiion 
is presented in more complex displays and 
is more subtly differentiated. 


Using a hospital campus map and its 
legend, identify a building that houses a 
specified medical department. (288) 


Level 4 
326-375 


Tasks require multiple-feature matching and 
integrating information from complex 
displays; however, the degree to which the 
reader must draw inferences is increased 
from the previous level. 


Circle Information relating to rates on a 
page from a telephone book. (358) 


Level 5 
376-500 


Tasks require a high degree of inferential 
reasoning and integrating Information from 
several sources. Tasks at this level require 
the ability to process information with a high 
degree of consistency using several 
documents. 


Interpolate information on a line graph to 
determina profits in a specified year. (408) 



SOURCE: Descriptions of literacy levels are adapted from Kirsch. Jungeblut, and Campbell, 1992; the examples of test 
tasks are from Educational Testing Service, 1992. 



NOTES: (a) A person at a given literacy level has an 80 percent or greater chance of performing tasks of the level's 
type correctly. 

(b) The difficulty of actual test items that require these operations is shown in parentheses. 
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TABLE 5.5 

DESCRPTION OF LITERACY LEVELS ON TALS QUANTITATIVE TEST 



Level and Score Range 



Description of Tasks 
Required by Test Items (a) 



Examples of Test Tasks (b) 



Level 1 
0-225 



Level 2 
226-275 



Level 3 
276-325 



Level 4 
326-375 



Level 5 
376-500 



Although there are no tasks on the test at 
Level 1, experience Indicates that 
Individuals at this level can perform addition 
and subtraction when the numbers are 
entered in a column format or the operation 
does not require the reader to tDorrow or 
carry. 

Tasks at this level require a single arithmetic 
operation involving numbers that are either 
stated in the question or easily identified In 
the document. 

Tasks require a single arithmetic operation; 
however, the reader must identify two or 
more numbers from various places in the 
document needed to solve the problem. 
Also, the operations needed to complete 
the task are indicated by phrases such as 
"how many" rather than explicitly stated. 

Tasks at this level require two or more 
sequential operations or the application of a 
single operation for which either the 
quantities or the operation cannot be easily 
determined. 

These tasks are the most demanding and 
require the reader to perform multiple 
operations. To determine the quantities and 
operations to complete a task, the reader 
must identify appropriate features of a 
problem from various parts of the document 
or rely on background knowledge. 



There are no tasks at this level on the test. 
All test items include text as well as 
arithmetic operations. 



Total the points accrued for several driving 
violations using a chart describing the 
point system. (273) 

Determine the total cost for an order after 
calculating the cost of two items and tax. 
(300) 



Calculate a ratio using figures found in a 
pie chart depicting population data. (346) 



Calculate the tax owed, using a schedule 
with a base rate and a percentage above 
this rate. (396) 



SOURCE: Descriptions of literacy levels are adapted from Kirsch, Jungeblut, and Campbell, 1992; the examples of test 
tasks are from Educational Testing Service, 1992. 

NOTES: (a) A person at a qiven literacy level has an 80 percent or greater chance of performing tasks of the level's 
type correctly. 

(b) The difficulty of actual test Items that require these operations is shown In parentheses. 
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performing at the indicated level can complete the specified Usks with a high degree of consistency - 
80 percent of the iime. Consider as an example a person who is performing at the 250 level on the 
document scale. This individual can be expected to perform tasks that are rated at this level correctly 
eight out of ten times, i.e., with an 80 percent probability of performing them correctly. This same 
individual would be expected to respond correctly to an item at the 300 level 40 percent of the time and 
could perform tasks at the 200 level with more than a 90 percent probability of responding correctly. 

The TALS document literacy test contains 26 items, the difficulty of which ranges from 179 to 
408 on the test scale. The difficulty of each question reflects the number of categories or features of 
information in the question, the number of distractors or plausible answers, the degree to which the test 
question is obviously connected with the information stated in the document, and the complexity of the 
document. As illustrated by Table 5.4, the easiest questions are those that require individuals to directly 
match a single piece of information in the question and text (e.g., to enter the account information on a 
savings withdrawal form). More difficult tasks require respondents to engage in a series of matches or 
to compare and contrast information in adjacent parts of the document (e.g., to use a map and its legend 
to locate a building). 

The TALS quantitative literacy test contains a total of 23 items, the difficulty of which ranges 
from 273 to 396 on the test scale. Unlike traditional quantitative tests, these tasks give a critical role to 
the processing of printed text, requiring reading skills in addition to mathematics skills. As shown in 
Table 5.5, the easiest items are those in which the numbers and required operations are made explicit. 
The tasks become increasingly difficult as numbers must be located and extracted from complex 
documents and when the required mathematical operations must be inferred (e.g., to calculate ratios from 
a pie chart). Overall, the difficulty of the items is determined by the particular arithmetic operation called 
for, the number of operations needed to perform the task, the extent to which the numbers are embedded 
in printed materials, and the extent to which an inference must be made to identify the type of operation 
to perform. 

The TALS was chosen to measure achievement outcomes in the GAIN evaluation after a review 
of 10 leading achievement tests and after consultation with experts. The TALS was chosen with the aim 
of measuring basic literacy skills related to employment, since employment is the ultimate goal of the 
GAIN program. The emphasis of the TALS on life skills materials and competencies was considered 



'^Kirsch and Jungeblui, 1992, pp. 85-86. 
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more appropriate for measuring the skills of GAIN registrants than a more academic test, given the goals 
of the GAIN program. TALS was also selected for its high internal reliability and its use in national 
studies, which allows comparisons of the literacy levels of the GAIN population to those of other groups 
(as shown below). It is important to understand that these tests were not used by the county education 
programs in this study to gauge student progress. Thus, the schools were not teaching the specific items 
in these tests. 

B. A Comparison of the Literacy Levels of GAIN Registrants and Other Populations 

Tests using the same kinds of items and literacy scales as the TALS have been employed in studies 
of the basic skills levels of other populations including JTPA applicants, participants in the Employment 
Service (ES) and Unemployment Insurance (UI) programs, a national sample of young adults ages 21 to 
25, and, most recently, a national sample of adults ages 16 to 64.^^ These results provide comparisons 
that are useful for characterizing and interpreting the literacy levels of the GAIN population. To provide 
a context for interpreting the effects of GAIN on achievement levels, the literacy levels of the GAIN 
control group are compared to those of other populations. The control group's test scores provide 
benchmarks for interpreting the literacy levels of this group of welfare recipients in the absence of GAIN. 

Table 5.6 reports on the distribution of test scores for these different populations and for GAIN 
controls. To enhance the comparability of the results, the scores are reported for sample members from 
the other studies who did not have a high school diploma or a GED. (This was a slightly different group 
from the GAIN controls, who either did not have one of these credentials or scored below 215 on either 
CASAS test.) Although this difference in sample definition should be noted, as Table 5.6 reports, an 
interesting distinction between GAIN controls and other populations is that the former made up a 
relatively larger segment of the overall GAIN population (66 percent) than the others did of their overall 
populations (ranging from 12 to 33 percent). When one considers only those who lacked a high school 
diploma or a GED, the literacy levels of GAIN control group members who were determined to need 
basic education were similar to those of other populations lacking a high school diploma or a GED: 29 
to 53 percent of these samples were at the most basic level (Level 1) on both the document and 
quantitative tests, and roughly three-quarters or more were at Levels 1 or l}'^ Compared to most other 
populations, the GAIN controls scored somewhat lower on the quantitative literacy test. Overall, the 



^^See Kirsch and Jungeblut, 1992; Kirsch et al., 1993. 

^''The national sample of adults ages 16 to 64 had a relatively large proportion of sample members at Levels 
1 and 2 of the TALS, in part because that sample included immigrants who were not proficient in English and 
individuals who were still in high school. 
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table illustrates that, across the different groups, individuals without a high school diploma were 
consistently at very low literacy levels, as measured by the TALS. 

An ETS study described individuals at Levels 1 and 2 as possessing relatively low-level 
information-processing skills and stated that they would probably face "severe restrictions on full 
participation in the workplace. "^^ Individuals at Levels 4 and 5, in contrast, demonstrate proficiencies 
useful for coping with complex printed or written material or for using text and two or more sequential 
arithmetic operations. The study states that these skills should be valuable resources for many types of 
jobs. 

The same ETS study examined the literacy levels attained by successful job-seekers in various 
occupations.^^ For the ES/UI population, the average document literacy score of service workers was 
the lowest, 262. This is within the range of scores that constitutes Level 2. Machine operators and 
laborers were also at Level 2. Average scores for clerical positions fell at the low end of Level 3, while 
scores for technical, professional, and managerial positions were at the upper end of that level. Overall, 
it appears that a large segment of the GAIN population may have scores 'that are below average for these 
types of positions. 

In sum, the literacy levels of the GAIN population indicate that, in the absence of any 
intervention, many of these welfare recipients are functioning at a low level - although it is a level 
similar to that of other populations without a high school diploma. The next subsection explores the 
effects the GAIN program had on literacy levels. 

C. TALS Score Impacts 

This subsection presents estimates of the impacts of GAIN on the achievement test scores for the 
TALS document and quantitative literacy tests. It compares scores for experimental group sample mem- 
bers with those for control group sample members. The differences between the two constitute the esti- 
mates of GAIN'S impacts on TALS scores. A comparison is given of the achievement test scores of ex- 
perimentals and controls for all counties combined, within each county, and within each of several sub- 
groups of the research sample. 

Before beginning the analysis, it is important to consider what elements of GAIN might increase 
TALS scores. In particular, it is important to note that basic education is the only component of GAIN 



^^Kirsch, Jungeblut, and Campbell, 1992, p. 8. 

^^Information on what literacy levels specific jobs require is not available. Therefore, it is difficult to determine 
what types of jobs individuals at various literacy levels could obtain. 
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specifically intended to achieve impacts on literacy. Unlike impacts on earnings and AFDC payment.^, 
impacts on literacy levels were not an explicit goal of non-education activities such as job search. 
Likewise, sanctioning and other program actions on nonparticipants may lead to impacts on AFDC pay- 
ments and even on earnings but would not appear likely to raise literacy test scores, although it is possible 
that some kinds of employment may have the side effect of improving the ability to score well on the 
TALS. In general, however, it would be prudent and in line with the design of GAIN to assume that any 
TALS score impacts for those determined to need basic education will come almost entirely from partici- 
pation in basic education. 

Consequently, any impacts on the average TALS scores for the entire sample of GAIN registrants 
in a county or group must be the product of the increase in the rate of basic education participation in 
the county or group and the average impact per participant. The results in this section are stated as 
average impact per experimental sample member. They are not estimates of the average impact per 
education participant. Since basic education nonparticipants are not expected to obtain TALS score 
impacts, however, the impact per participant will be several times the measured impact per experimental. 
This poses no conceptual difficulty because the TALS score impacts will be directly comparable to other 
impacts measured per experimental. It does, however, present a particularly sharp statistical difficulty: 
Participants in basic education may have experienced TALS score impacts, but the effect may not be seen 
for the sample as a whole if basic education participation rates within the experimental group were not 
high enough. For example, if the impact on a participant in basic education was to raise a TALS score 
by 10 points, on average, and the experimental-control difference in participation in basic education was 
0.30 (i.e., 30 percentage points), then the impact per experimental was 0.30 x 10 = 4-3 points. This 
will be too small to attain statistical significance with the sample size available, even though the 10-point 
impact on participants may be of policy significance. Technically, this problem would be described as 
a problem of "statistical power" rather than a problem of bias.^^ 

A complete analysis might therefore proceed in two steps. The first step, which is taken in this 
report, is to look for TALS score impacts on the full sample of experimental and controls - basic edu- 
cation participants and nonparticipants combined. This analysis will be called "experimental " because 



carry the illustration further, suppose that the possible statistical error of the impact per experimental is 
•f /- 5 points. The +3 experimental estimate would then have a range of possible error of -2 to -f 8. which includes 
zero (i.e., no impact). The impact per participant, if that could be estimated directly, might have a range of 
possible error of -f 5 to -f 15. Translated back into the per experimental basis, this would yield a range of possible 
enor of -f 1.5 to +4.5 (i.e.. -f5 x 0.30 to -f 15 x 0.30). This range is narrower than the original -2 to -f 8 and 
docs not include zero. 
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it is based on the fundamental comparison of randomly assigned program and control groups. This 
analysis will reveal TALS score impacts of moderate to large magnitude. It will not reliably reveal TALS 
score impacts that are small but might still affect future earnings.^^ A second step, which is beyond 
the scope of this report, would be to attempt to estimate TALS score impacts directly on participants 
within the experimental group. This second step, which was not part of the original evaluation plan,^-^ 
might help determine whether participants obtained modest TALS score impacts but were too few in 
number for those impacts to show up in the full sample. This analysis may be called "nonexperimental" 
because it is not based on a comparison of two randomly assigned groups. It is, instead, based on a 
comparison of basic education participants in the experimental group with basic education nonparticipants 
in the experimental group. 

To summarize the experimental results: Large impacts on TALS scores were found in San Diego, 
but no evidence of TALS score impacts was found for any other county. It was also found that TALS 
score impacts accrued almost entirely to sample members who scored highest on the CASAS tests given 
just prior to random assignment. The exact magnitude of the impacts in San Diego and among the high 
CASAS scorers is uncertain, however, owing to the small sample sizes in each county and each subgroup. 
Much smaller differences in TALS score impacts were found between sample members classified as "most 
disadvantaged" and sample members of less disadvantagedness. Finally, only a very weak correlation 
was found across counties and across subgroups between the number of additional hours of participation 
in basic education produced by GAIN and increases in TALS scores. Counties and subgroups for which 
increases in basic education hours were relatively large did not necessarily have large impacts on TALS 
scores. 

1. Analysis issues > As discussed in Chapter 2, the TALS analysis sample was a subset of sample 
members selected for the follow-up survey. Some effort was made to choose the TALS sample so as to 
minimize the number of individuals who would not be able to take the test because they were not 
proficient in English and to maximize the number who would have participated in basic education. Thus, 
although the TALS sample was less representative of the impact sample than was the survey sample as 



^'The sample sizes available are sufficient to detect reliably about a 0.4 standard deviation impact on TALS 
score per education participant. This power calculation assumes a two-tailed t-test, at statistical significance level 
0.10, with power 0.80, and R-square 0.36 (estimated from an all-county combined TALS score regression). 

^^The experimental analysis was not part of the original evaluation plan, either. The original GAIN survey did 
not incorporate a literacy test. That was added later. But the existence of randomly assigned experimental and 
control groups made it relatively straightforward to add the TALS and compare scores for experimentals and 
controls. A nonexperimental analysis would not be straightforward. 
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a whole, the TALS sample makes it possible to capture more accurately the TALS score impacts 
associated with participation in basic education activities, particularly ABE and GED activities. 

Appendix Table E. 1 shows the participation rates in selected activities for the TALS sample, using 
self-reported information from the survey. It indicates that participation rates were somewhat higher for 
the TALS sample than for the overall sample. For the TALS sample, 36 percent of experimentals and 
5 percent of controls participated in ABE/GED activities, for an overall difference of 31 percentage 
points. The comparable increment for the whole sample was 24 percentage points, with 30 percent of 
experimentals and 6 percent of controls having participated in ABE/GED activities (see Table 4.1). The 
TALS sample was slightly more likely to participate in job search but participated to the same degree in 
work experience (see Tables E.l and 4.2). 

TALS scores were analyzed for 1 , 1 15 respondents. This represented a response rate of 65 percent 
among those slated to be given the TALS. An analysis of differences between TALS respondents and 
nonrespondents may be found in Appendix A. In brief, this analysis found that, compared to nonre- 
spondents, TALS respondents had longer welfare histories and were more likely to be categorized as 
"most disadvantaged." TALS score impacts based on the respondent sample nevertheless appear to 
represent closely the impacts for the full sample of respondents and nonrespondents. The all-important 
comparison between experimentals and controls who took the TALS revealed only the expected 
differences :n distribution across counties plus some differences across ethnicity categories, both of which 
were corrected by regression adjustment. Thus, comparing the TALS scores of experimentals and con- 
trols should give unbiased, internally valid estimates of GAIN'S impacts on achievement. 

Two forms of TALS scores are analyzed: numerical scores and TALS score categories (i.e., 
literacy levels). Impacts on numerical scores are stated both as absolute numerical effects and as percents 
of the standard deviation of the test score calculated for all controls in the research sample. ^-^ Stating 
impacts as a "percent of standard deviation" is particularly important for achievement tests because the 
absolute score impact cannot be judged large or small without reference to some unit of measurement. 
For example, a test score impact of 25 would be considered small if it were 2 percent of a standard 
deviation but large if it were 25 percent of a standard deviation. Impacts as a percent of standard 
deviation can also be compared across the two TALS tests in this study and between this and other 
studies. 



^•'Standard deviations were computed for the sample of all controls with follow-up TALS scores, with all 
counties weighted equally. 
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2. TALS score impacts by county and subgroup. Table 5.7 presents number of scheduled 
hours of basic education and TALS scores for the sample of test-takers in all counties, for each county 
and for two sets of subgroups. Hours and scores are given as averages for experimentals and controls 
and as the difference between averages, which is the estimate of GAIN'S impact.^'* Averages for hours 
of basic f- ducation count zero for nonparticipants. The TALS score presented is the sum of scores on the 
document and quantitative tests. The separate results for document and quantitative literacy tests parallel 
those for the combined score (see Appendix Table E.2). 

Estimates of total scheduled hours of basic education for the counties for the TaLS respondent 
sample differed slightly from those for the full survey respondent sample determined to need basic 
education shown in Table 4.5. The relative positions of counties are virtually identical across the two 
samples, however. Among the TALS respondent sample, Los Angeles increased hours of basic education 
the most, and Riverside increased them the least. The Riverside increase was quite small and was the 
only increase that was not statistically significant. The other three counties constituted a middle range, 
clustering around an increase of about 200 hours of basic education participation per experimental sample 
member, on average. 

Among counties, impacts on TALS scores were found only for San Diego. Combined document 
and quantitative literacy scores averaged 454 for controls and 488 for experimentals, for a statistically 
significant impact, of 33.8 points. This impact represents a gain of 35.6 percent of a standard deviation, 
a large impact, given that the estimate combined basic education participants and nonparticipants. None 
of the other county impact estimates were statistically significantly different from zero, with the exception 
of a negative TALS score impact in Riverside. The negative estimate in Riverside may not fully reflect 
a real program effect but may, instead, have been artificially magnified by an experimental-control 
difference in the percentage of each research group that took the TALS test. A difference in test-taking 
between research groups was large and statistically significant only in Riverside and may have created 
unmeasured differences in the characteristics of experimentals and controls in the TALS sample in that 
county (see Appendix A). The pooled estimate of TALS score impacts for all counties was close to zero 



^'^Estimates are regression-adjusted, controlling for pre-random assignment demographic characteristics and 
baseline CASAS scores. All results were obtained from regressions on the entire TALS respondent sample. Full- 
sample estimates give each county equal weight. County and subgroup "difference" estimates were obtained from 
dummy variables, which are the cross products of experimental group status and county or subgroup. County and 
subgroup estimates are unweighted. 
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and was not statistically significant.^^ The all-county estimate of the TALS score impacts, from a 
regression in which Riverside was excluded and the other four counties were weighted equally (not shown 
in the table), was 6.9 points, not statistically significant. The variation in TALS score impacts across 
the five counties was statistically significant, reflecting the quite large differences between San Diego on 
the high end and Riverside and Tulare on the low end. These cross-county differences could not be 
explained by demographic and CASAS score differences among sample members in the TALS respondent 
samples across counties. 

The county differences would appear instead to reflect differences in the implementation of the 
basic education component across counties. The relevant differences in implementation do not appear 
to be linked strongly to the absolute level or the experimental-control increment in hours of basic educa- 
tion, however. The greatest absolute amount of, and increment in, basic education participation was seen 
in Los Angeles, but that county had a TALS score impact close to zero. Alameda and Tulare had 
experimental-control differences in hours of basic education that were slightly greater than those in San 
Diego, but they did not have measurable TALS score impacts. Across counties, the simple correlation 
coefficient between the experimental-control difference in hours of basic education and the experimental- 
control difference in TALS scores was -i-O.ZS, indicating a weak relationship. That leaves the nature, 
organization, aiid quality of basic education as factors that could explain the observed county difference 
in TALS score impacts. ^'^ 

Breaking the sample into baseline CASAS score subgroups reveals a concentration of TALS score 
impacts among registrants with greater literacy levels at the time of random assignment. Sample mem- 
bers who passed both CASAS baseline tests, representing 27.6 percent of the total sample, obtained a 
large impact. Combined TALS scores for controls in this subgroup averaged 526, well above controls 
in the other subgroups. But experimental in this subgroup reached 544 on the TALS, for a statistically 



Appendix Table E.2 shows a statistically significant impact of 4.5 percentage points for all counties pooled 
in the number achieving TALS Level 3, 4, or 5. However, 3.6 of the 4.5 percentage points were contributed by 
San Diego. 

^^Conditional impact estimates were obtained for the counties by adding to the impact regression terms for the 
interaction of subgroup membership with the experimental status dunrniy variable. The res^^iting county TALS 
impact estimates were quite similar to the unconditional county impact estimates shown in the table. The two sets 
had a simple correlation coefficient of +0.99. 

^^These results do not necessarily mean that more time in basic education does not increase the impact of basic 
education. The results may merely mean that quality of education is important and is not necessarily associated with 
duration of education. Long basic education programs may not always be high-quality programs. But high-quality 
basic education may have greater effects the longer students attend. In addition, high-quality basic education may 
achieve more in a short time than lower-quality basic education might achieve over a longer period of participation. 
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significant impact of 17.8 points, a gain of 18.7 percent of a standard deviation. Impacts for this 
subgroup were found mostly in San Diego (not shown in the table), although smell and not statistically 
significant TALS score impacts were found outside San Diego for sample members who passed both 
baseline CAS AS tests. 

Table 5.7 also shows that control group average TALS scores decreased with performance on the 
CAS AS baseline tests, as would be expected. TALS score impacts also decreased, however. Sample 
members who passed only one CAS AS obtained a 2.2 point TALS impact, which was not statistically 
significant. Sample members who failed both CAS AS tests obtained a negative but not statistically 
significant estimate. The small group without a CASAS test score, 3.0 percent of the sample, obtained 
a large negative estimate for the TALS score impact. The variation in TALS score impacts across 
CASAS subgroups was statistically significant. The magnitude of impact was not related to the increment 
in hours of basic education, however. The subgroup that scored 215 or above on both baseline CASAS 
tests had a relatively small hours difference and a large TALS impact; the subgroup that scored below 
215 on both CASAS tests had the largest hours difference and a negative TALS effect. The simple 
correlation coefficient between incremental hours and TALS impact was -0.85, excluding the "no score" 
subgroup (-0.26 including the "no score" subgroup), indicating that hours invested in basic education 
were largest for the subgroups with the smallest TALS impacts. 

These findings suggest that GAIN had the most difficulty raising TALS scores for individuals who 
started out at relatively low literacy levels. Those at the top of the CASAS distribution for this 
population were able to achieve TALS impacts and took less than the average time in basic education to 
do it. Those at the bottom of the CASAS distribution had difficulty achieving TALS score impacts, even 
when they spent substantially more time in basic education. 

This pattern of CASAS subgroup results was driven by San Diego. In that county, TALS score 
impacts for the passed both, passed one, failed both, and no score subgroups were +79.3, +29.7, -23.7, 
and -1 13.8, with the first estimate being statistically significant. Experimental-control differences in basic 
education hours within San Diego for the same subgroups were +186, +9, +421, and +401, with the 
first and third estimates being statistically significant. Thus, as for the sample as a whole, TALS score 
impacts in San Diego decreased in moving down the CASAS baseline subgroups, and the largest 
increments in basic education hours came for the subgroups with the smallest TALS score impacts. This 
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pattern strengthens the conclusion that the bottom CAS AS subgroups had difficulty improving their TALS 
scores, even with considerable basic education and even in the county with positive and statistically 
significant TALS score impacts. 

At the bottom of the table, results for a "most disadvantaged" subgroup are presented. These are 
sample members who were long-term AFDC recipients, without employment in the year prior to random 
assignment and with no high school diploma or GED when they were randomly assigned. This subgroup 
would be predicted to have had relatively low follow-up rates of employment and long future AFDC 
receipt. In addition, as discussed in previous chapters, the table indicates that basic education hours and 
incremental basic education hours were larger for the most disadvantaged, suggesting that GAIN 
registrants who will be on AFDC a long time tend to spend more time in basic education. TALS score 
impacts were also somewhat larger for the most disadvantaged, but neither impact was statistically signifi- 
cant, and the difference in impacts between the two subgroups was not statistically significant either. 
This result does suggest that work and welfare history and diploma status may be less important in 
predicting academic success than baseline measures of actual academic achievement such as the CAS AS. 

Table 5.8 shows details of TALS score impacts for San Diego, The table indicates that quite 
similar TALS score impacts were achieved in both the document and quantitative literacy tests: 16,0 
points and 17.9 points, respectively (both statistically significant). The table also shows that the effect 
was primarily to move people from TALS Level 1 into Levels 2 and 3 on the document literacy test and 
into Level 3 on the quantitative literacy test. According to the ETS research discussed in the previous 
section, this shift represents an improvement from having a severe labor market handicap to a level 
possessed by many employees in service, clerical, and other low-skills occupations. Overall, in San 
Diego, there was an 18.2 percentage point increase — nearly a doubling - in the number of 
experimental scoring at TALS Levels 3 through 5 on either test,^^ 



^^For counties other than San Diego, the TALS score impacts for the passed both, passed one, failed both, and 
no score subgroups were +7.7, +0.2, -16,5, and -108.1, with only the last being statistically significant. 
Experimental-control differences in basic education hours were +210, +209, +295, and +224, all statistically 
significant. 

^^The shift out of TALS Level 1 in San Diego was unexpected, given the concentration of TALS score impacts 
in the subgroup that scored 215 or above on both baseline CAS AS tests. This may reflect some random error 
stf.mming from the small sample sizes for the counties and subgroups. It suggests that some controls in the 
subgroup that scored 215 or above on both baseline CAS AS tests scored worse on the TALS in San Diego than in 
other counties. If so, the TALS score impact estimated for San Diego would exceed the actual impact of th'^ 
program in that county. 
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TABLE 5.8 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S TWO- TO THREE-YEAR IMPACTS ON TALS SCORES IN SAN DIEGO COUNTY 





Experi mentals 


Controls 


Difference 


Document and quantttatrve literacy tests 








Combined average score 


488 


454 


33.8 ** 


(aiTTerence/sianGarG oevtaiionj (a) 






35.6% 












I 4.D 


17.1 


-2.5 




4 1 .y 


23.8 


18.2 ** 


Document literacy test 










^40 


229 


16.0 * 


fdiffprpncp/<5tanHflrH Hpviatinn^ ^a^ 






30.6% 


Scored at (%) 












34.7 


-7.7 


Level 2 


48.0 


44.8 


3.2 


Level 3 


21.9 


18.3 


3.6 


Level 4 


3.1 


2.1 


1.0 


} owol ^ 


0.0 


0.0 


0.0 


Scored at 








i pvpjc 1 O 


/O.O 


79.6 


—4.5 


1 pvpjc f^'-'-S 




^0.4 


4.5 


Quantitative literacy test 








AvPTflnp cr^nrp 


243 


225 


17.9 ** 


^differencp/<5tandflrH Hpvifltinn^ ia\ 






36.3% 


Scored at (%) 










36.9 


49.8 


-12.9 


Level 2 


31.6 


29.7 


1.8 


Level 3 


28.6 


20.0 


8.6 


Level 4 


2.9 


0.5 


2.5 


Level 5 


0.0 


0.0 


0.0 


Scored at (%) 








Levels 1 -2 


68.4 


79.5 


-11.1 


Levels 3-5 


31.6 


20.5 


11.1 


Sample size 


60 


54 





SOURCE: MDRC calculations using GAIN TALS data. 



NOTES: Calculations for this table used data for all TALS respondents in San Diego, including those who did 
not participate in basic education. 

Estimates are regression -adjusted using ordinary least squares, controlling for pre-random 
assignment characteristics of sample members. Rounding may cause slight discrepancies In calculating sums 
and differences. 

A two-tailed t-test was applied to differences between experimental and control groups. 
Statistical significance levels are indicated as *** = 1 percent; ** = 5 percent; * = 10 percent. 

(a) TTie standard deviation of the outcome measure is for all controls, with counties weighted equally. 
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The preceding analysis gives estimates of average TALS score impacts per experimental group 
sample member, derived from a comparison of experimentals and controls. It would also be of interest 
to estimate TALS score impacts per basic education participant by comparing TALS scores of participants 
in the experimental group with those of nonparticipants in the experimental group. Such an analysis 
would be called "nonexperimental" because the comparison of basic education participants with basic 
education nonparticipants is not a comparison of two randomly assigned groups. These two groups are, 
instead, defined by activities occurring after the randomization that created the experimental and control 
groups. A nonexperimental analysis was not originally planned for the present evaluation and is not 
included in this report. 

One important objective of such a nonexperimental analysis would be to increase the statistical 
power of the TALS score impact estimates. In particular, it would be desirable to confirm the 
experimental finding that TALS score impacts were achieved only by basic education participants in San 
Diego and not by basic education participants in other counties, it would also be important to revisit 
some other questions: Do TALS score impacts increase with length of stay in basic education? Are 
different subgroups of participants affected differently by participation in basic education? In addition, 
it would be valuable to investigate whether impacts on TALS scores differ significantly across schools 
and whether length of stay, subgroup, and school effects are different under different county implementa- 
tion approaches. 

III. GAINES Impacts on Earnings and AFDC Payments for Those Detennined to Need Basic 
Education 

Any assessment of the fiill impacts of basic education in GAIN must take into account impacts on 
earnings and AFDC receipt. However, the labor market and AFDC impacts of basic education are likely 
to take longer to appear than are the impacts of job search and other elements of GAIN. Those other 
elements of GAIN aim for immediate employment. In contrast, basic education (and other skills-building 
activities) intentionally put off immediate employment with a view to increasing the long-run ability of 
participants to find and hold jobs with higher earnings and with earnings that increase over time. A 
typical pattern of impacts for a research sample containing *a substantial percentage of basic education 
participants might therefore begin with small or even negative effects during the participation period and 
shortly afterwards. This initial "investment phase" would be followed by a period of increasing impacts. 
Finally, after several years, the impacts of basic education on earnings and AFDC might begin to exceed 
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those of immediate job entry activities. In velfare-to-work programs, this period may take five years 
from the point of program registration (i.e., from the point of random assignment in GAIN).^^ 

Two-year impacts (covering follow-up quarters two through nine) on earnings and AFDC 
payments for sample members determined to need basic education were presented in the preceding 
report^^ and are summarized in Appendix Tables IE. 3 and E.4 of this report. Over a two-year follow-up 
period, Butte and Riverside showed large earnings gains and AFDC reductions for the AFDC-FGs 
determined to need basic education. Alameda, Los Angeles, and San Diego showed only small two-year 
earnings impacts for this group, although they produced mid-sized AFDC reductions, which exceeded 
their earnings gains. Tulare produced small two-yea. earnings impacts and no AFDC impacts. 

Given the expected time pattern of small initial impact and later impact growth, two years of 
follow-up may not be sufficient to reveal the full impact of basic education in GAIN. It is possible, 
however, to look a bit beyond the first two years of follow-up by examining outcomes for individuals 
who entered the research samples during the early part of the random assignment period. These "early 
cohorts" have more than nine quarters of follow-up. Differences between experimentals and controls in 
quarterly earnings are shown for these cohorts in Figure 5.1. These quarterly earnings impact estimates 
for the early in-need-of-basic-education cohorts suggest that the available two-year estimates may, as 
suspected, not be indicative of the longer-term effects of basic education in GAIN. In Alameda, Los 
Angeles, and Tulare, Figure 5,1 shows some upward movement of earnings impacts only just beginning 
around quarter seven or eiglit and continuing into year three. If these upward movements continue 
beyond that point and appear in the late cohort as well, then longer-term earnings impacts may be much 
larger than the two-year estimates for the group in these counties that was determined to need basic 
education. If so, then longer-term AFDC impacts may also increase, although past research has shown 
that AFDC reductions do not always follow directly from earnings gains. It would therefore be 
prudent to await longer-term data on earnings and AFDC payments before making a summary judgment 
about the impacts of basic education on the portion of the sample determined to need it. 



^^An example of this pattern may be seen in the five-year follow-up results for the experimental evaluation of 
the Baltimore Options program (Fricdlander and Burtless, forthcoming). It was only in follow-up year five that 
earnings impacts for this program, which included some education and training, began to show evidence of 
exceeding those of programs with a strong focus on immediate job entry. 

^^Fricdlander, Riccio, and Freedman, 1993. 

^^AFDC impacts for the early cohorts of the group determined to need basic education show a leveling off or 
the start of a decline by year three in Butte, Los Angeles, Riverside, and San Diego. They show some movement 
toward greater impacts in Alameda and Tulare. 
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FIGURE 5.1 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON EARNINGS FOR THE EARLY COHORTS 
OF AFDC-FG REGISTRANTS 
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FIGURE 5.1 (continued) 
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SOURCE AND NOTES: See Figure 2.2 In Friedlander, Riccio, and Freedman, 1993, pp. 51-54. The early cohorts 
In this figure consist of individuals who were randomly assigned as follows: 

Alameda July 1989-Docember 1989 

Butte March 1988-March 1989 

Los Angeles July 1989-September 1989 

Riverside August 1 988-March 1 989 

San Diego August 1 988-March 1 989 

Tulare January 1989-September 1989 
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At this time, however, certain two-year impact estimates point to some longer-term estin tes that 
will be of special interest. In particular, it will be of interest to determine longer-term earnings and 
AFDC impacts for the group determined to need basic education in Tulare, where they achieved the 
largest increase in GED receipt, and in San Diego, where they achieved impacts on TALS scores. It will 
also be of interest to examine further the subgroup of the in-need-of-basic-education sample who scored 
215 or above on both CAS AS tests, since these sample members achieved most of the GED and TALS 
score impacts estimated for GAIN in this report. The two-year data reveal that San Diego, Tulare, and 
the subgroup that scored 215 or above on both CASAS tests generally obtained small impacts on earnings 
and AFDC payments in the short term."^^ It will be important to examine later estimates for these 
groups to see whether the GED and TALS score impacts they obtained were associated with longer-term 
impacts on earnings and AFDC. If not, then the effectiveness of the additional GED receipt and 
in'^/eas'^d academic achievement in producing changes in work and welfare behavior would be called into 
question. 

IV. Summary 

The empirical findings presented in this chapter suggest that the content and organization of basic 
education services in GAIN may be as important as the amount of basic education received in increasing 
the educational achievement and attainment of GAIN registrants. The GAIN program in Tulare produced 
a striking impact of 19 percentage points on GED and high school diploma receipt. This was followed 
by an 8 percentage point impact in Alameda. Tulare enhanced the basic education services offered to 
GAIN students, particularly by providing counseling and close monitoring. Both Alameda and Tulare 
not only assigned a substantial proportion of those determined to need basic education to basic education 
services, but also encouraged registrants to move from ABE to GED programs. 

The GAIN program in San Diego produced statistically significant impacts on educational 
achievement. San Diego's impact on the combined document and quantitative TALS score was 34 points 
(representing a gain of 36 percent of a standard deviation). It should be noted, however, that sample 
sizes for this analysis were relatively small. County and subgroup estimates therefore indicate the general 



^"^Using the available records data, two-year impacts on eamings and AFDC payments were calculated for the 
sample of GAIN survey respondents used for this report. For eamings, the two-year impacts for San Diego, Tulare, 
and the subgroup that scored 215 or above on both CASAS tests were less than half the all-county average impact. 
For AFDC payments, the two-year impact estimate for San Diego was as large as the all-county average impact, 
but impacts for Tulare and for the subgroup that scored 215 or above on both CASAS tests were well below the 
average. 
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order of magnitude of TALS score impacts rathei man the precise amount of each effect. The results do 
suggest that no county program was able to produce effects on achievement like those in San Diego, 
which offered services on a county-wide basis that were more intensive and closely monitored and were 
intended to be tailored to the needs of welfare recipients. These findings also indicate that it is important 
to distinguish between the educational achievement and attainment outcomes » since one can be realized 
in the absence of the other. 

Impacts on educational attainment and achievement were obtained primarily for individuals at 
higher initial levels of literacy. In terms of GED and high school diploma receipt, those who scored 215 
or above on both the reading and mathematics CASAS tests at the time of random assignment had a 20 
percentage point impact. Those scoring 215 or above on only one of those tests had only a 5 percentage 
poirt impact. Those scoring below 215 on both tests or having no score (i.e. , composed mostly of those 
who were unable to take the test because they could not read English) had no impact. As noted in 
Chapter 3, subgroups with lower initial literacy levels accounted for a small proportion of GED 
participants and a relatively greater proportion of ABE participants. This pattern suggests that many in 
the lower literacy groups did not make a transition from ABE to GED. There were several possible 
reasons for this: Obtaining a GED may not have been the GAIN program's educational goal for them 
(consistent with the GAIN regulations, some counties encouraged participation in job search after the 
completion of ABE); or they xpzy not have reached satisfactory basic skills levels in the program; or they 
may have left the program before they made sufficient gains to enter a GED program. The emphasis 
Tulare gave to linking participation in ABE with subsequent GED participation may have contributed to 
the large impacts on GED receipt in that county. For those who were initially at higher literacy levels, 
the GAIN program may have provided an accessible route for acquiring the specific knowledge needed 
to pass the GED test. In addition, the program may haVe offered the moral support, support services 
(such as child care), or "push" these individuals needed to obtain their GED. Findings from the TALS 
analysis indicate that GAIN was more successful in raising the achievement levels of those who started 
out at higher initial literacy levels. 

The inq)acts on achievement and attainment do not appear to have been strongly correlated with 
the amount of participation in basic education services. Counties and subgroups with small impacts on 
achievement and attainment often had average or above-average experimental-control differences in rates 
of participation in and total scheduled hours of basic education. This was true most notably for Los 
Angeles and the subgroup that scored below 215 op both CASAS tests. Small achievement and 
attainment impacts did not result from any failure to provide basic education services, although, 
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particularly for those at lower literacy levels, it cannot be determined whether the amount of basic 
education received was enough. Conversely, large impacts for particular counties or subgroups did not 
result from exceptionally large amounts of participation in basic education. The counties thai produced 
the largest achievement and attainment impacts (San Diego. Tulare, and Alameda) appear to have 
succeeded not through greater quantity of participation but rather through their program practices and the 
content and organization of the education experiences provided. Sample members at higher initial literacy 
levels obtained large educational achievement and attainment impacts but spent shorter periods of time 
in basic education activities than did those at lower initial literacy levels. They appear to have obtained 
those impacts, at least in part, because they were able to benefit from the kinds of basic education offered 
and not because they obtained more basic education than other subgroups. 

In the counties that produced impacts on educational achievement or attainment, the GAIN 
program did not result in earnings impacts within the two-year follow-up period that is available for the 
full sample at this time. Results for a small early-enrolling sample with three years of follow-up suggest 
that the two-year impacts may not be indicative of the longer-term effects of basic education in GAIN. 
In Alameda. Los Angeles, and Tulare, the early-enrolling sample shows a growth in earnings impacts just 
beginning in the second year of follow-up and increasing into the third year. Thus, longer follow-up is 
needed to determine whether the investment in educational attainment and achievement will pay off. At 
the end of the two-year follow-up period. Riverside, which operates a program using both job search and 
education services and has a strong focus on quick employment, had large, statistically significant impacts 
on earnings and welfare receipt for those determined to need basic education. These results indicate that 
the county's strategy had little effect on education outcomes, but had a more immediate effect on 
employment and earnings. 

This study raises questions about how existing adult education programs, which normally serve 
a voluntary population, can be structured or adapted to produce educational gains for the less-skilled 
segments of the welfare population. Individuals with lower levels of basic skills stayed in basic education 
programs for relatively long periods of time, and the education programs provided them with an 
"opportunity to learn." to the extent that could be measured. The TALS analysis suggests that this 
group's achievement gains were minimal; their educational attainment impacts were also small. This 
indicates that the amount and type of education services received by this group may not have been 
sufficient, particularly given the inconsistent attendance patterns. Different and perhaps more 
comprehensive services may be needed to produce results for this group. 
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Some caution should be exercised in interpreting the TALS score impact results. Sample sizes 
for counties and subgroups were small, and the finding of large impacts for the San Diego program 
should be verified by smdies of similar program approaches at other localities. Waiting for longer-term 
impact results on earnings and AFDC receipt will also be important in judging the full effects of GAIN 
on academic skills that are valued in the labor market. Some positive effects may not have been captured 
by the TALS and may only show up later on, at the workplace, in the form of higher earnings. This 
might occur if the basic education that was provided focused on skills that were not tested by the TALS. 
While the TALS was designed to measure performance across a broad range of literacy levels, it is 
possible that the TALS was not sensitive enough to pick up achievement gains for individuls at very low 
literacy levels. Moreover, it should be noted that TALS test-takers did not have the same incentives as 
the GED test-takers. Passing the GED test was probably seen by most GED test-takers as a way to obtain 
higher earnings. Doing well on the TALS could have had no financial benefit, and TALS test-takers may 
therefore have been less motivated to do th^ir best. This may have been particularly true for the lower 
literacy subgroups, for whom any academic skills test would present a formidable challenge. Finally, 
it may be that achievement gains of a policy-relevant magnitude were made by some basic education 
participants, but by too few to appear clearly in the overall experimental-control difference. 
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APPENDIX A 
SURVEY RESPONSE ANALYSIS 



Data on education outcomes for this report came from two sources: the GAIN registrant survey 
and the Test of Applied Literacy Skills (TALS). The literacy test was administered to a selected group 
of sample members during the survey interview. Not all sample members selected for the survey could 
be interviewed, however. Some could not be located, and some refused or were unable to be 
interviewed. And some of those selected to be tested could not be interviewed or could not be tested at 
the interview. Sample members who completed the survey or TALS are called respondents. Sample 
members selected for the survey or for TALS who did not complete them are called nonrespondents , 
This appendix presents an analysis of response patterns undertaken to determine whether impacts on 
receipt of a GED (or a high school diploma) or literacy would be biased by the absence of completed 
instruments for some sample members. Such an analysis is routinely performed in field studies using 
survey and test data.' 

Whenever survey or test response rates are less than 100 percent, two kinds of biases may be 
present. First, if experimentals and controls respond differently, then the characteristics of the two 
research groups may be dissimilar. If so, the fundamental comparison between experimentals and 
controls may be invalid, and impact estimates may be biased. Second, the sample of completed surveys 
and tests may not well represent the full sample of program registrants who were selected for interview- 
ing. In that case, the impact estimates for survey or test respondents may not easily generalize to all 
program registrants. 

For the GAIN samples, the characteristics of experimental and control group respondents do not 
appear to have been markedly dissimilar, either among survey respondents or among TALS respondents. 
In both the survey and TALS samples, several differences were found in the characteristics of respondents 
and nonrespondents. Therefore, estimates based on the survey and TALS respondent samples may not 
accurately represent impacts for the fiill samples. The analysis suggests, however, that any biases may 
be quite small. 



'The issue of item nonresponse - i.e., the failure to respond to a given question or set of questions - is not 
examined here. 
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Overall Rate of Response 



Table A. 1 gives the number of completions and the response rates for the survey and TALS for 
experimentals and controls in each county and in all counties combined. For the survey, the total rate 
of response was 79.5 percent, only slightly below the targeted response rate of 80 peicent. This response 
rate was high enough so that the survey probably represented the full evaluation sample quite well. 
Across counties, response rates ranged from 76.7 percent in Riverside to 83.1 percent in Alameda. 
County variation in response rates was not statistically significant. More important is that none of the 
counties had a very low response rate. Within experimental and control groups, overall response rates 
were similar (78.4 percent for experimentals compared to 80.7 percent for controls). In addition, none 
of the experimental-control differences within counties was large or statistically significant. These results 
suggest that the fundamental comparison of experimentals and controls did not produce biased impact 
estimates. 

Response rates were lower for the TALS. Test scores were available for 65 percent of sample 
members selected to be surveyed and tested. This rate was lower than the overall survey response rate 
because some survey respondents could not or would not take the TALS. A response rate for TALS 
under 70 percent raises questions about the generalizability of impact results from the TALS respondent 
sample to the broader evaluation sample. This issue will be addressed below. There was also a wider 
range of response rates across counties for the TALS than for the survey. Response rates ranged from 
57.9 percent (in Tulare) to 78.2 percent (in Los Angeles). These cross-county differences in response 
rates for the TALS were statistically significant at the 0.05 level. Between experimentals and controls, 
there was no sizable difference in the response rates for the TALS sample as a whole. In Riverside, 
controls responded at a higher rate than did experimentals; 67.8 percent versus 54.8 percent, a 
statistically significant difference. Differences in response rates between research groups were smaller 
. in the other counties. 

IL Response Patterns for the Survey 

Table A. 2 presents the results of an analysis of survey response. (TALS response is considered 
in the next section.) Among respondents, the characteristics of experimentals and controls were generally 
similar, indicating that the fundamental comparison of GED and high school diploma receipt and other 
outcomes should be unbiased. Differences in the distribution of respondents across counties were found, 
but these were expected because the experimental -.control ratio in Riverside was 2:1 but was roughly 1:1 
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TABLE A.1 

FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
RESPONSE RATES FOR GAIN REGISTRANT SURVEY AND TALS, 
BY COUNTY AND RESEARCH GROUP 



County and 
Research Group 



Survey 



Number of 
Compietions 



Response 
Rate (%) 



TALS Test 



Number of 
Completions 



Response 
Rate (%) 



Aiameda 

Experimentals 

Controls 

Total 



225 
241 
466 



80.6 
85.5 
83.1 



163 
171 
334 



67.9 
73.7 
70.8 



Los Angeles 
Experimentals 
Controls 
Total 



237 
254 
491 



79.3 
81.9 
80.6 



95 
91 



81.2 
75.2 
78.2 



Riverside 

Experimentals 

Controls 

Total 



416 
231 
647 



75.8 
78.3 
76.7 



153 
80 
233 



54.8 
67.8 
58.7 



San Diego 

Experimentals 

Controls 

Total 



221 
210 
431 



77.0 
76.9 
77.0 



60 
54 
114 



65.2 
62.1 
63.7 



Tulare 

Experimentals 

Controls 

Total 



254 
262 
516 



81.7 
80.6 
81.1 



124 
124 
248 



62.0 
54.4 
57.9 



All Counties 
Experimentals 
Controls 
Total 



1.353 
1.198 
2,551 



7S.4 
80.7 
79.5 



595 
520 
1.115 



64.1 
66.2 
65.1 XX 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: A response rate is the number of completions taken as a p^^rrcent of sample nr^embers selected to be surveyed or tested. 
Butte County was not included in the survey. 
No weighting is applied to counties in the "ail counties" estimates. 

The number of survey completions includes both AFDC-FG and AFDC-U registrants. The number of TALS completions 
includes only AFDC-FG registrants (AFDC-U registrants were r»t included in the TALS sample). Four sample members who took 
the TALS were not included in this table because they were missing kjentifying informatk)n. 

A chi-square test was applied to differences In response rates between experinnentals and controls for all counties and 
within each county. Statistk:al significance levels are indicated as *** = 1 percent; = 5 percent: * = 10 percent. 

A chi-square test was applied to the variatk)n in total response rates across counties. Statlstk:at significance levels are 
indicated as xxx = 1 percent; xx = 5 percent; x = 10 percent. 
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TABLE A.2 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
SELECTED CHARACTERISTICS OF GAIN REGISTRANT SURVEY RESPONDENTS 

AND NONRESPONDENTS 



Characteristic 



Survey Sample 



Respondents Nonrespondents 



Survey Respondents 



Experimentals 



Controis 



Research sample status (%) 
Experimental 
Control 

County (%) 
Alameda « 
Los Angeles 
Riverside 
San Diego 
Tulare 

Received GEO or high school diploma (%) 

Range of scores on both CASAS tests (%) 
215 or above on both 
215 or above on one 
214 or below on both 
No score 

if score available 

Average reading score 
Average niath score 

Limited English proficiency (%) 

Employed in prior year (%} (a) 

If employed in prior year 
Average earnings ($) 

Received AFDC in prior year (%) (a) 

If received AFDC in prior year 
Average AFDC amount ($) 
Average number of months 
receiving AFDC in prior year 

Most disadvantaged (%) (a),(b) 

Average number of children 

Had a child under age 6 (%) 

Average age (years) 

Sex(%) 
Female 
Male 

Ethnicity (%) 

White, non-Hispanic 
Hispanic 

Black. rx>n-Hispanic 
Asian, other 



53.0 
47.0 



18.3 
19.2 
25.4 
16.9 
20.2 

22.0 



21.7 
40.3 
14.1 
23.9 



225.5 
209.2 

19.7 

33.1 

3762 
88.7 



7097 
10.8 



40.3 
2.1 
20.5 
35.4 



80.3 
19.7 



27.1 
36.8 
28.5 
7.5 



56.4 
43.6 



14.4 
17.9 
29.9 
19.6 
18.2 

22.2 



21.4 
40.7 
12.9 
25.0 



225.4 
208.9 

18.8 

31.2 

3230 
85.6 



6322 
9.7 *** 



35.0 
2.1 
22.9 
34.6 



70.3 
29.7 



34.6 
28.1 
29.0 
8.3 



16.6 
17.5 
30.7 
16.3 
18.8 

22.4 



21.5 
39.9 
15.9 
22.8 



225.4 
209.1 

19.7 

31.9 

3647 
89.8 



7118 
10.9 



42.5 
2.1 
21.6 
35.2 



80.2 
19.8 



26.3 
36.8 
29.6 
7.2 



20.1 
21.2 
19.3 
17.5 
21.9 

22.2 



20.7 
40.2 
13.0 
26.1 



225.4 
209.0 

20.8 

34.0 

3936 
88.9 



7042 
10.7 



39.2 
2.1 
20.2 
35.8 



80.6 
19.4 



25.4 
36.2 
30.0 
8.4 



Sample size 



2,551 



659 



1.353 



1.198 



(continued) 
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TABLE A.2 (continued) 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not included in the survey. 

Respondent and nonrespondent estimates are unweignted. 

Each county was given equal weight in the averages for experimentals and controls within the survey respondent sample 
analysis, except for the comparison of the distribution of experimentais and controls across the research counties. Weighting 
implies that experimental and control averages may not always bracket respondent averages. 

A chi-square test or a t-test was applied to the differences between respondents and nonrespondents, and between 
experimentais and controls within the respondent sample. Statistical significance levels are indicated as *** = 1 percent; 
:= 5 percent; * = 10 percent. 

(a) 15 cases within the survey -eligible sample lacked the identifying information necessary to calculate certain measures 
relating to prior employnr>ent and AFDC receipt. These cases are not included in analyses requiring these data. Ten of the cases 
were survey respondents and 5 were si-rvey nonrespondents. Of the 10 survey respondent cases missing identifying 
infornnatlon, 6 were experimental^ end 4 were controls. 

(b) The "most disadvantaged" individuals are those who did not have a high school diploma or GED, were long-term 
welfare recipients, and had no earnings In the prior year. 
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elsewhere (see Chapter 2). County differences were corrected for by weighting in the main analysis ■ 
participation and educational attainment impacts, and no bias from them should remain. Small difference: 
were also found in CASAS scores and level of disadvantagedness. 

To further assess the importance of any experimental-control differences within the survey 
respondent sample, the dummy variable indicating membership in the experimental group was 
regressed on demographic information and baseline CASAS test scores. The regression R-square was 
0.026 out of a possible maximum of i .000, which was statistically significant at the 0.01 level. The only 
independent factor that contributed to a statistically significant degree to the regression R-square was 
county. Thus, the weighting correction for county in the participation and educational attainment impact 
analyses should remove the only source of potential bias in the experimental-control comparison. 

On the left part of the table is a comparison of survey respondents with those sample members 
selected for the survey but for whom a completed survey was not obtained. Several differences may be 
noted. Respondents were more likely to be from Alameda or Los Angeles. They were more often 
female and non-white. They tended to be slightly older, to have had longer histories of prior AFDC 
receipt, and to fall into the "most disadvantaged" category. 

In a regression of the 0/1 dummy indicating a respondent, statistically significant predictors 
included CASAS, sex, ethnicity, prior earnings, and especially AFDC receipt histoiy. This indicates that 
the underlying difference in response probably was associated with those factors alone. The regression 
R-square was 0.046 and was statistically significant at the 0.01 level. 

The differences in characteristics between respondents and nonrespondents may mean that impacts 
calculated on the respondent subsample do not closely represent the impacts tor all persons selected for 
the survey. Such bias need not occur, however, even when respondents and nonrespondents differ. It 
may be that their differences were not related to size of impact. To investigate the possible magnitude 
of any bias, demographic characteristics and baseline CASAS scores were used to predict the impact on 
percent receiving a GED or a high school diploma during the follow-up period for the full sample of 
respondents and nonrespondents. It was estimated that impacts would have been the same had the survey 
response rate been 100 percent.^ Although this analysis does not account for possible differences in 



^Receipt of a GED or a high school diploma was regressed on demographics and CASAS scores separately for 
experimental and control group survey respondents. Then, for all sample members, experimental and control group 
regression coefficients were used to predict receipt of such a credential. The mean of the difference is the predicted 
impact. For the full sample, a 6,5 percentage point impact was predicted, equal to a predicted 6.5 percentage point 
impact for the respondents-only sample. The predicted impact estimate for respondents differs slightly from the 
estimate reported in Chapter 5 because the latter was not regression-adjusted. 
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unobservables, it does suggest that potential bias will be small if the estimate of the impact on GED or 
high school diploma receipt for the respondent subsample is accepted as the estimate for the full survey 
sample. 

III. Response Patterns for the TALS 

Table A. 3 presents the corresponding estimates for the TALS sample. As for the registrant survey 
as a whole, experimentals and controls within the TALS respondent sample were fairly similar. Research 
groups differed in distribution across county owing to the high ratio of experimentals to controls in 
Riverside. Beyond this, as Table A. 3 indicates, experimentals who completed the TALS failed both 
baseline CASAS tests at a higher rate than did their control group counterparts. Experimentals also more 
often had limited English proficiency. 

Baseline CASAS and limited English differences could affect TALS score impact estimates. In 
a regression of the 0/1 experimental-group dummy on demographic and CASAS variables, however, 
CASAS scores and limited English were not statistically significant. Only the county and ethnicity factors 
were statistically significant. Overall R-square was 0.038 and was statistically significant at the 0.05 
level. These results indicate that CASAS and limited English differences in part stemmed from the 
greater incidences of Hispanics in the experimental group and possibly from other cross-county 
differences among registrants. The use of regression adjustment in calculating TALS score impacts in 
the main study should correct for those differences and yield unbiased impact estimates. 

Comparing respondents to nonrespondents (in the left part of the table) shows a pattern similar 
to the survey as a whole. As before, respondents were more likely to have been from Alameda or Los 
Angeles, to be female and non-white, to have had longer histories of prior AFDC receipt, and to fall into 
the "most disadvantaged" category. However, although not shown in the table, respondents to TALS 
were no more likely than nonrespondents to have participated in basic education during the follow-up 
period.^ For sample members with CASAS scores, respondents had a slightly lower average score on 
the CASAS reading test. 

The regression of TALS respondent status on demographic characteristics and CASAS scores 
yielded a statistically significant (at the 0.01 level) R-square of 0.061. In the regression, differences 



^Using survey information, thi basic education ''ever participated rate for TALS respondents was calculated 
as 22.0 percent (including experimentals and controls) and for nonrespondents was 21.1 percent. The latter estimate 
was based on the 264 TALS nonrespondents who were survey respondents. The difference was not statistically 
significant. 
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TABLE A.3 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
SELECTED CHARACTERISTICS OF TALS RESPONDENTS AND NONRESPONDENTS 



Characteristic 



TALS Sample 



Respondents Nonrespondents 



TALS Respondents 



Experimentals 



Controls 



Research sample status (%) 
Experimental 
Control 

County (%) 
Alameda 
Los Angeles 
Riverside 
San Diego 
Tulare 

Received GEO or high school diploma (%) 

Range of scones on both CABAS tests (%) 
215 or above on both 
21 5 or above on one 
21 4 or below on both 
No score 

If score available 

Average reading score 
Average math score 

Limited English proficiency (%) 

Employed in prior year {%) 

if employed in prior year 
Average earnings ($) 

Received AFDC in prior year {%) 

If received AFDC in prior year 
Average AFDC amount ($) 
Average number of months 
receiving AFDC in prior year 

Most disadvantaged (%) (a) 

Average number of children 

Had a child under age 6 (%) 

Average age (years) 

Sex(%) 
Female 
Male 

Ethnicity (%) 

White, non-Hispanic 
Hispanic 

Black, non-Hispanic 
Asian, other 

Sample size 



53.4 
46.6 



30.0 
16.7 
20.9 
10.2 
22.2 

21.3 



27.6 
49.2 
20.1 
3.0 



224.7 
208.6 

3.4 

30.1 

3,323 
91.8 

7118 
11.1 

43.1 
2.0 
16.5 
34.2 



90.7 
9.3 



29.3 
27.6 
40.9 
2.2 

1,115 



55.6 
44.4 



23.0 
8.7 
27.4 
10.9 
30.1 

18.9 



28.4 
51.8 
16.4 
3.5 



226.0 * 
209.3 

4.5 

26.4 

2,913 
85.5 *** 



6386 
10.1 ♦** 



38.6 
1.9 
16.2 

33.6 



86.1 
13.9 



39.1 
25.4 
31 .6 
4.0 

599 



27.4 
16.0 
25.7 
10.1 
20.8 

17.8 



28.2 
46.2 
23.2 
2.4 



224.4 
208.8 

5.3 

29.6 

3.213 
90.9 



6936 
10.9 



44.6 
1.9 
14.7 
33.9 



89.4 
10.6 



28.8 
32.0 
37.5 
1.7 

595 



32.9 
17.5 
15.4 
10.4 
23.8 

18.2 



29.7 
48.9 
16.5 
4.8 



225.4 
208.7 

2.9 

32.1 

3.507 
91.3 



6980 
10.8 



41.5 
2.0 
13.3 
34.6 

92.0 
8.0 



31.5 
26.9 
38.6 
3.0 

520 

(continued) 
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TABLE A.3 (continued) 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not included In the survey. 
The TALS sample includes only AFDC-FGs, 

Four sample members who took the TALS were not included in this table beciuse they were missing identifying 
Infornwtion. 

Respondent and nonrespondent estimates are unweighted. 

Each county was given equal weight in the averages for experimentals and controls within the survey respondent sample 
analysis, except for the comparison of the distribution of experimentals and controls across the research counties. Weighting 
implies that experimental and control averages may not always bracket respondent averages, 

A Chi -square test or a t-test was applied to the differences between respondents and nonrespondents, and between 
experimentals and controls within the respondent sample. Statistical significance levels are indicated as *** = 1 percent; 
= 5 percent: * = 10 percent, 

(a) The "most disadvantaged" Individuals are those who did not have a high school diploma or GED. were long-term 
welfare recipients, and had no earnings In the prior year. 
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between respondents and nonrespondents resulted from county, sex, ethnicity, prior earnings, and AFDC 
receipt history. The differences between respondents and nonrespondents may not lead to bias in 
generalizing the TALS impact results, however. In fact, it was predicted that the impact on combined 
document and quantitative literacy scores would be about one point less for the full TALS sample than 
for the TALS respondent sample, a very small difference.^ This result suggests that the potential bias 
in generalizing estimates of TALS score impact from the respondent sample to the full TALS sample 
should be small. 

One condition that may have led to bias was found in Riverside. As already noted. Riverside was 
the only county in which the response rate for experimentals and controls differed to a large and 
significant degree. These differences may have been associated with differences in the characteristics of 
sample members who responded. In particular, it was found that experimentals in Riverside had a higher 
rate of scoring below 215 on both CAS AS tests: 17.6 percent versus 8.8 percent for controls. At the 
same time, however, only 3.3 percent of Riverside experimentals in the TALS sample could not take the 
CASAS tests (a situation that usually occurred because of difficulty in reading English) compared to 12.5 
percent of controls. Although CASAS scores were included as control variables in the TALS score 
impact regression, it may be that the observed differences reflected other, unmeasured differences 
between experimentals and controls. If so, then some of the prior propensity of experimentals to score 
lov/er on TALS may not have been corrected for by the regression. This could have made the estimated 
experimental-control differential in TALS scores in Riverside more negative that the true differential in 
that county. It is possible that the negative TALS score impact estimate in Riverside resulted partly from 
uncontrolled pre-random assignment differences between experimentals and controls. 



*See footnote 2 for the prediction method. The predicted TALS score impact for the full sample was -2.9 
points, for the respondent subsample, -3.2 points. This latter predicted impact differs slightly from the impact 
estimate reported in Chapter 5, because the regression used in this appendix did not weight all counties equally. 
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APPENDIX B 

SUPPLEMENTAL TABLES AND FIGURE TO CHAPTER 2 
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TABLE B.1 

SCHOOLS INCLUDED IN THE PROVIDER ATTENDANCE DATA COLLECTION 



County 



School 



Butte 
Riverside 



Oroville Adutt School 

Beaumont Adutt School 

Coachella Adutt School 

Moreno Valley Adutt School 

Mount San Jacinto Adult School 

Palm Springs Adutt School 

Riverside Community Educational Services 



San Diego 



Center City Community College 
East San Diego Community College 
Educational Cuttural Complex 
Escoiidido Adutt School 
Grossmont Adutt School 
Miracosta College 
Sweetwater Adutt School 
Vista Adutt Center 



Tulare 



Exeter Adutt School 
Lindsay Adult School 
Porterville Adutt School 
Proteus 

Tulare Adutt School 
Visalia Adutt School 
Woodlake Adutt School 
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APPENDIX C 
SUPPLEMENTAL TABLES TO CHAPTER 3 



TABLE C.I 



FOR SURVEY RESPONDERS: 
LENGTH OF TIME FROM RANDOM ASSIGNMENT TO SURVEY INTERVIEW. 
BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Measure 



Los All 
Alameda Angeles Riversicie San Diego Tulare Counties 



AFDC -Us (a) 
All 

Counties 



29.0 



Average months from 
random assignment to 

interview date 30.2 37.0 26.7 25.9 25.7 29.1 

Percentage distribution of 
number of months from 
random assignment to 
interview date 

Less than 24 months 0.0 0.0 6.7 4.7 19.3 6.1 

24 months 3.0 0.0 25.4 41.3 15.0 16.8 

25-28 months 55.2 2.1 49.1 49.2 63.0 43.9 

29-32 months 22.5 11.1 17.2 4.7 2.7 11.7 

33-36 months 4.3 38.0 1.5 0.0 0.0 8.8 

37-40 months 7.7 33.4 0.0 0.0 0.0 8.2 

41 -44 months 7.3 15.4 0.0 0.0 0.0 4.5 

45 months or more 0.0 0.0 0.0 0.0 0.0 0.0 



3.1 
19.3 
45.5 
9.7 
9.0 
10.1 
3.4 
0.0 



Sample size 



466 



389 



582 



380 



441 



2258 



293 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not included in the GAIN survey. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 

Distributions may not add to 100.0 percent because rounding. 

(a) The AFDC-U sample does not include any registrants from Alameda. 
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TABLE C.2 



FOR ABE/GED PARTICIPANTS: 
AVERAGE. MEDIAN, AND PERCENTAGE DISTRIBUTION OF MONTHS IN ABE/GED 
WITHIN A TWO-YEAR FOLLOW-UP PERIOD. BY AFDC STATUS ANC ( OVhiT,' 











AFDC-FGs 






AFDC -Us (a) 


Measure 


Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tuiare 


All 

Counties 


All 

Counties 


Average number of 
months In ABE/GED 


7.6 


10.0 


5.1 


5.1 


8.6 


7.3 


6.6 


Median number of 
months in ABE/GED 


5.5 


9.0 


3.5 


3.6 


7.0 


6.1 


4.1 


Pgi'^p{3gg distribution 
of number of months in 
ABE/GED 

Less than 2 months 

2-6 months 

7-12 months 

13-16 months 

19-24 months 


8.8 
50.5 
22.0 
12.1 

6.6 


7.7 
23.1 
38.5 
25.6 

5.1 


34.7 
42.9 
14.3 
2.0 
6.1 


27.9 
48.8 
14.0 
9.3 
0.0 


14.7 
35.3 
27.9 
11.8 
10.3 


18.8 
40.1 
23.3 
12.2 
5.6 


27.7 
32.6 
25.2 
8.3 
6.1 


Percent participating in 
ABE/GED at the end of 
the follow-up period 


20.9 


10.3 


10.2 


18.6 


17.7 


15.5 


8.6 


Sample size 


91 


39 


49 


43 


66 


290 


23 



SOURCE: MDf^C calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not included in the GAIN survey. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 
Distributions may not add to 100.0 percent because of rounding. 

This table contains estimates for sample members from the experimental group and includes participation in 
activities arranged through the GAIN program, as well as those that registrants participated in on their own initiative, 
(a) The AFDC-U sample does not include any registrants from Alameda. 
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TABLE C.3 



FOR ABE/GED PARTICIPANTS: 
AVERAGE, MEDIAN, AND PERCENTAGE DISTRIBUTION OF TOTAL SCHEDULED HOURS IN ABE/GED 
WITHIN A TWO-YEAR FOLLOW-UP PERIOD, BY AFDC STATUS AND COUNTY 



AFDC-FGs 



Measure 



Alameda 



Los 
Angeles 



Riverside San Diego 



Tulare 



All 

Counties 



AFDC -Us (a) 
All 

Counties 



Average weekly 
scheduled hours 
in ABE/GED 



16.1 



24.7 



17.7 



Average total scheduled 

hours in ABE/GED 516.9 993.9 474.0 
Median total scheduled 

hours in ABE/GED 351.4 905.7 209.1 



24.7 



555.8 



398.6 



17.3 



623.3 



490.4 



20.1 



632.8 



453.0 



Percentage distribution 
of total scheduled hours 
in ABE/GED 

Under 100 hours 12.1 2.6 34.7 16.3 5.9 14.3 

100 - 249 26.4 5.1 20.4 14.0 25.0 18.2 

250-499 20.9 12.8 14.3 25.6 19.1 18.5 

500-999 25.3 33.3 16.3 30.2 26.5 26.3 

1.000-1,499 9.9 28.2 4.1 9.3 17.6 13.8 

1,500andover 5.5 17.9 10.2 4.7 5.9 8.8 



18.2 
612.9 
471.4 



30.0 
5.0 
23.0 
25.1 
10.8 
6.1 



Sample size 



91 



39 



49 



43 



68 



290 



23 



SOURCE AND NOTES: See Table C.2. 
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TABLE C.4 



FOR ESL PARTICIPANTS: 
AVERAGE. MEDIAN. AND PERCENTAGE DISTRIBUTION OF NUMBER OF MONTHS 
ATTENDING AND TOTAL SCHEDULED HOURS IN ESL WITHIN A TWO-YEAR 
FOLLOW-UP PERIOD, BY AFDC STATUS 



Measure 



AFDC-FGs 



Average number of 
months in ESL 

Median number of months in ESL 



9.4 
7.1 



AFDC -Us 



8.4 
6.3 



Percentage distribution of 
number of months in ESL 

Less than 2 months 

2-6 months 

7-12 months 

13-18 months 

19-24 months 



4.6 
41.5 
25.8 
13.2 
14.9 



0.0 
56.7 
30.0 
6.7 
6.7 



Percent participating in ESL at 
the end of the follow-up period 

Average weekly scheduled 
hours in ESL 



36.7 



17.8 



26.7 



16.0 



Average total scheduled 
hours in ESL 



720.8 



643.8 



Median total scheduled 
hours in ESL 



439.3 



440.0 



Percentage distribution of 
total scheduled hours in ESL 

Under 100 hours 

100-249 hours 

250-499 hours 

500-999 hours 

1.000-1,499 hours 

1 .500 hours or more 



6.2 
22.5 
32.7 
12.1 

7.1 
19.5 



16.7 
0.0 

40.0 

26.7 
6.7 

10.0 



Sample size 



43 



14 



SOURCE: MDRC calculations using data from the GAIN registrant survey. 

NOTES: Butte County was not included in the GAIN survey. 

The AFDC-FG sample includes registrants from Alameda, Los Angeles. Riverside, San Diego, and Tulare. 
The AFDC-U sample includes registrants from ail these counties, except Alameda. The estimates presented are the 
average of the county estimates, with each county weighted equally. 

This table contains estimates for sample members from the experimental group and includes participation m 
activities arranged through the GAIN program, as well as those that registrants participated in on their own initiative. 

Distributions may not add to 100.0 percent because of rounding. 
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TABLE C.5 



FOR BASIC EDUCATION PARTICIPANTS: 
AVERAGE. MEDIAN. AND PERCENTAGE DISTRIBUTION OF NUMBER OF MONTHS ATTENDING AND 
TOTAL SCHEDULED HOURS IN BASIC EDUCATION ACTIVITIES WITHIN A VNO- TO THREE-YEAR 
FOLLOW-UP PERIOD. BY AFDC STATUS AND COUNTY 











AFDC-FGs 






AFDC -Us (a) 


Measure 


Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


All 

Counties 


Average number 
of months in basic 
education activities 


67 


11.3 


5.5 


5.6 


9.1 


8.0 


8.8 


Median number 
of nnonths in basic 
education activities 


6.6 


10.6 


5.1 


5.1 


7.8 


6.1 


7.4 


Percentage distribution 
of number of months in 
basic education activities 

Less than 2 months 

2-6 nnonths 

7-12 months 

13-18 nrxjnths 

19-24 months 

25-28 months 

29 months or nnore 


8.3 
43.5 
26.9 
13.0 
3.7 
2.8 
1.9 


9.4 
25.0 
34.4 
10.9 
15.6 
1.6 
3.1 


24.0 
52.0 
17.3 
1.3 
4.0 
1.3 
0.0 


23.5 
52.9 
14.7 
5.9 
2.9 
0.0 
0.0 


13.8 
31.3 
31.3 
10.0 
12.5 
1.3 
0.0 


15.8 
40.9 
24.9 
8.2 
7.8 
1.4 
1.0 


19.0 
30.5 
32.9 
6.1 
1.8 
6.2 
3.6 


Percent participating in 
basic education at end 
of follow-up period 


16.7 


17.2 


8.0 


20.6 


15.0 


15.5 


12.8 


Average weekly scheduled 
hours in basic education 


15.9 


24.2 


17.7 


24.1 


17.4 


19.8 


19.5 


Average total scheduled 
hours in baste education 


575.4 


1092.8 


493.0 


531.5 


665.6 


671.7 


828.5 


Median total scheduled 

hours in bftsic AHijfMition 


437.2 


1 057 .5 












Percentage distribution 
of total scheduled hours 
in basic education 
Under 100 hours 
100-249 hours 
250-499 hours 
500-999 hours 
1.000-1.499 hours 
1 ,500 hours or more 


11.1 
24.1 
15.7 
31.5 
10.2 
7.4 


4.7 
7.8 
12.5 
18.8 
32.8 
23.4 


24.0 
14.7 
33.3 
17.3 
2.7 
8.0 


16.2 
11.8 
23.5 
36.8 
7.4 
4.4 


5.0 
23.8 
17.5 
30.0 
13.8 
10.0 


12.2 
16.4 
20.5 
26.9 
13.4 
10.7 


20.1 
3.8 
19.8 
27.4 
17.3 
11.6 


Sample size 


108 


64 


75 


68 


80 


395 


44 



SOURCE: MDRC calculations using data from the GAIN registrant survey and from county AFDC records. 



NOTES: The follow-up period for the survey ranged from 26 to 37 nx>nths, on average, across the five counties. 
See Appendix Table C.1 for further infornwition on the foltow-up period in each county. 
Butte County was not included in the GAIN survey. 

This table contains estimates for sample members from the experimental group and includes participation m 
activities arranged through the GAIN program, as well as those that registrants participated in on their own initiative. 
The "all county" estimate is the average of the county estinf«tes. with each county weighted equally. 
Distributions may not add to 100.0 percent because of rounding. 
Basic education Includes GED. ABE. and ESL. 

(a) The AFDC-U sample does not include any registrants from Alameda. 
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APPENDIX D 

SUPPLEMENTAL TABLES AND FIGURE TO CHAPTER 4 



23G 



TABLE D.1 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S IMPACTS ON PERCENTAGE OF THOSE PARTICIPATING IN SELECTED ACTIVITIES 
AT THE END OF A TWO- TO THREE-YEAR FOLLOW-UP PERIOD, 
BY AFDC STATUS AND COUNTY 



AFDC-FQs 



Outcome and 




Los 








All 


All 


Research Group Alameda 


Angeles 


Riverside 


San Diego 


Tulare 


Counties 


Counties 


Percent participating in 
















ABE/QED at the end of 
















follow-up 
















Experimental 


7.6 


4.3 


1.0 


4.7 


4.6 


4.4 


1.3 


(Control** 


2.1 


2.0 


1.6 


2.7 


0.9 


1.8 


0.0 


Difference 


5.5 *** 


2.3 


-0.5 


2.1 


3.7 ** 


2.6 *** 


1.3 


Percent participating in 
















ESL at the end of 
















follow-up 
















Experimentals 


0.4 


1.6 


0.5 


2.6 


1.4 


1.3 


2.5 


Controls 


0.4 


0.0 


0.0 


0.5 


1.3 


0.5 


2.4 


Difference 


0.0 


1.6 * 


0.5 


2.1 


0.1 


0.9 


0.1 


Percent participating in 
















job search activities at 
















the end of follow-up 
















Experimentals 


1.3 


0.5 


0.5 


0.5 


0.9 


0.8 


0.0 


Controls 


0.8 


0.0 


0.0 


0.5 


0.0 


0.3 


0.0 


Difference 


0.5 


0.5 


0.5 


0.0 


0.9 


0.5 


0.0 


Percent participating in 
















vocational training at 
















the end of follow-up 
















Experimentals 


3.1 


4.3 


0.5 


2.1 


1.4 


2.3 


0.5 


Controls 


1.7 


2.5 


1 .6 


2.7 


0.4 


1.8 


3.1 


Difference 


1.5 


1.8 


-1.0 


-0.6 


1.0 


0.5 


-2.6 * 


Percent participating in 
















post-secondary education 
















at the end of follow-up 
















Experimentals 


4.4 


1 .6 


2.8 


3.7 


2.8 


3.1 


3.2 


Controls 


4.6 


2.5 


3.1 


2.7 


2.2 


3.0 


1 .8 


Difference 


-0.1 


—0.9 


-0.2 


1.0 


0.6 


0.1 


1.4 


Percent participating In 
















work experience at the 
















end of follow-up 
















Experimentals 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Controls 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Difference 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Percent participating in 
















any activity at the end of 
















follow-up 
















Experimentals 


12.4 


10.2 


2.8 


10.0 


7.9 


8.7 


5.2 


Controls 


5.0 


4.5 


3.1 


5.8 


2.7 


4.2 


5.4 


Difference 




5.7 


-0.3 


4.2 


5.2 


4.5 *** 


-0.2 


Sample size 
















Experinnentals 


225 


187 


388 


191 


216 


1.207 


146 


Controls 


241 


202 


194 


189 


225 


1,051 


147 



SOURCE AND NOTES: See Table 4.2. 
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TABLE D.2 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S TWO-YEAR IMPACTS ON AVERAGE NUMBER OF MONTHS IN SELECTED ACTIVITIES, 

BY AFDC STATUS AND COUNTY 



AFDC-FGs AFDC -Us (a) 



Outcome and 




Los 








All 


All 




rMamcua 


Anrtoloc 






Tulare 






Average number of 
















months in ABE/GED 
















Experimental 


3.3 


2.2 


0.8 


1.4 


2.9 


2.1 


1.3 


Controls 


0.3 


0.3 


0.2 


0.3 


0.2 


0.3 


0.1 


Difference 


3.0 *** 


1.9 *** 


0.6 




2 y *** 


1 .9 *** 


^ 2 *** 


Average number of 
















months In ESL 
















Experimentals 


0.3 


0.9 


0.2 


0.4 


0.3 


0.4 


1.0 


Controls 


0.1 


0.3 


0.2 


0.1 


0.2 


0.2 


0.3 


Difference 


0.2 


0.6 ** 


0.0 


0.3 ** 


0.1 


0.3 *** 


0.7 ** 


Averaae number of 
















months In job search 
















activities 
















Experimentals 


0.2 


0.1 


0.3 


0.4 


0.2 


0.2 


0.2 


Controls 


0.1 


0.0 


0.0 


0.1 


0.0 


0.0 


0.0 


Difference 


0.1 ** 


0.1 ** 


0.3 


*** 0.3 *** 


0.2 *** 


0.2 *** 


0.2 ** 


Avpranp niimhpr of 
















months in vocational 
















training 
















Experimentals 


0.5 


0.3 


0.4 


0.5 


0.3 


0.4 


0.3 


Controls 


0.4 


0.3 


0.4 


0.7 


0.1 


0.4 


0.5 


Difference 


0.1 


0.0 


0.0 


-0.2 


0.2 * 


0.0 


-0.2 


















months in post- 
















secondary education 
















Experimentals 


1.4 


0.8 


0.8 


1.1 


0.8 


1.0 


0.4 


Controls 


1.1 


0.3 


1.0 


0.6 


0.6 


0.7 


0.2 


Difference 


0.3 


0.4 


-0.1 


0.5 


0.2 


0.2 * 


0.1 


Average number of 
















months In work 
















experience 
















Experimentals 


0.2 


0.0 


0.0 


0.0 


0.1 


0.1 


0.0 


Controls 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Difference 


0.1 ** 


0.0 


0.0 


0.0 ** 


0.1 


0.1 *** 


0.0 


Sample size 
















Experimentals 


225 


187 


388 


191 


216 


1.207 


146 


Controls 


241 


202 


194 


189 


225 


1.051 


147 



SOURCE AND NOTES: See Table 4.2. 
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TABLE D.3 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S TWO-YEAR IMPACTS ON AVERAGE TOTAL SCHEDULED HOURS IN SELECTED ACTIVITIES. 

BY AFDC STATUS AND COUNTY 









AFDC 


-FGs 






AFDC-Us (a) 


Outcome and 
Research Group 


Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


All 

Counties 


Average total scheduled 
hours in ABE/GED 

Experimentals 

Controls 

Difference 


224.5 
20.5 
'204.0 *** 


221.7 
23.1 
198.6 *** 


76.2 
12.7 

63.5 *** 


152.3 
25.9 
126.4 *** 


210.2 
6.8 
201 .4 *** 


177.0 
18.2 
158.8 *** 


138.6 
5.5 
133.1 *** 


Average total scheduled 
hours in ESL 

Experimentals 

Controls 

Difference 


18.9 
3.4 
15.5 


83.1 
17.0 

66.0 *** 


13.4 
11.4 
2.0 


25.9 
11.7 
14.1 


25.6 
11.1 
14.4 


33.4 
10.9 

22.5 *** 


83.2 
25.6 
57.6 ** 


Average total scheduled 
hours in job search 
activities 

Experimentals 

Controls 

Difference 


11.3 
6.1 
5.1 


12.1 
0.0 
12.1 * 


18.5 
0.5 

18.0 *** 


39.6 
5.3 
34.3 *** 


11.6 
0.2 

1 1 .4 *** 


18.6 
2.4 

16.2 *** 


16.7 
2.1 

14.6 ** 


Average total scheduled 
hours in vocational 
training 

Experimentals 

Controls 

Difference 


36.6 
45.2 
-8.6 


32.3 
18.8 
13.4 


44.9 
46.2 
-1.3 


50.4 
-7.2 


32.8 

1 o.c 

19.6 


39.4 
3.2 


20.8 

fi7 Q 

-47.1 


Average total scheduled 
hours in post-secondary 
education 

Experimentals 

Controls 

Difference 


96.0 
76.1 
19.8 


93.8 
27.9 
66.0 * 


65.8 
86.4 
-20.7 


71.2 
68.5 
2.7 


61.7 
49.6 
12.1 


77.7 
61.7 
16.0 


28.3 
17.0 
11.2 


Sample size 
Experimentals 
Controls 


225 
241 


187 
202 


388 
194 


191 
189 


216 

225 


1.207 
1.051 


146 
147 



SOURCE AND NOTES: See Table 4.2. 
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TABLE D.4 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
AVERAGE WEEKLY SCHEDULED HOURS IN SELECTED ACTIVITIES FOR PARTICIPANTS. 
BY AFDC STATUS. COUNTY, AND RESEARCH GROUP 









AFDC 


-FGs 






AFDC -Us (a) 


Outcome and 

Research Group Alameda 


Los 
Angeles 


Riverside 


San Diego 


Tulare 


All 

Counties 


All 

Counties 


Participants' average weekly 
scheduled hours in ABE/GED 

Experimentals 

Controls 


16.0 
137 


25.0 
16.6 


17.5 
13.6 


24.3 
16.9 


17.1 
14.4 


19.9 
15.2 


18.7 
16.8 


Participants' average weekly 
scheduled hours in ESL 

Experimentals 

Controls 


14.4 
9.0 


22.2 
12.5 


18.4 
11.3 


17.1 
15.9 


17.2 
13.8 


17.6 
13.0 


15.7 
18.4 


Participants' average weekly 
scheduled hours in job search 
activities 

Experimentals 

Controls 


23.8 
22.2 


24.2 
0.0 (b) 


19.5 
30.0 


19.5 
17.1 


14.9 
2.0 


20.4 
17.2 


19.5 
18.5 


Participants' average weekly 
scheduled hours in vocational 
training 

Experimentals 

Controls 


17.8 
23.6 


23.7 
13.8 


23.0 
20.6 


22.2 
21.7 


24.5 
25.4 


22.3 
21.0 


19.5 
25.5 


Participants' average weekly 
scheduled hours in post- 
secondary education 

Experimentals 

Controls 


16.1 
16.8 


26.0 
18.2 


17.5 
17.7 


16.5 
16.4 


17.4 
19.6 


18.7 
17.7 


15.7 
14.0 



SOURCE: See Table 4.2. 



NOTES: See Table 4.2. 

The sample size for each row varies, depending on the number of sample members who participated in the 
activity in each county. 

Data on weekly scheduled hours in work experience activities were not collected in the survey. 

(a) The AFDC-U sample does not include any registrants from Alameda. 

(b) No control group members in Los Angeles participated in job search. 
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FIGURE ai 

FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
MONTHLY PARTICIPATION LEVELS IN ABE/GED FOR AFDC-FG SURVEY RESPONDERS, 

BY RESEARCH STATUS AND COUNTY 

Alamdda 




0 10 11 12 13 14 15 ie 

Months Since Random Assignment 



20 21 22 23 



Los Angeles 




0 10 11 12 13 14 15 ie 

Months Since Random Assignment 



18 10 20 21 22 23 



Riverside 



25 



^20 J- 

LU 
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I 15 



? 10 



0 



- r - * T 
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0 10 11 12 13 14 15 16 

Months Sinoe Random Assignment 



20 21 22 23 



Experlmentals 
Controls 
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FIGURE ai (continued) 



San Diego 




10 11 12 13 U 15 16 

Months Sinoo Rancjom Assignment 



Tulare 




B 10 t1 12 13 14 15 16 

Months Since Random Assignmcmt 



20 2t 22 23 24 25 



Experimentais 
Controls 



SOURCE: MDRC calculations using data from the GAIN registrant sun/ey. 
NOTES: See Table 4.2. 
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APPENDIX E 
SUPPLEMENTAL TABLES TO CHAPTER 5 



TABLE E.1 



FOR THOSE DETERMINED TO NEED BASiC EDUCATION: 
GAIN'S TWO- TO THREE-YEAR IMPACTS ON PARTICIPATION LEVELS 
IN SELECTED ACTIVITIES FOR TALS TEST RESPONDERS. 
BY COUNTY 



Outcome and 
Research Group 



Alameda 



AFDC-FGs 



Los 
Angeles 



Riverside 



San Diego 



Tulare 



All 
Counties 



Ever participated in 
ABE/GED 

Experimentals 

Controls 

Difference 

Ever participated in 
ESL 

Experimentals 

Controls 

Difference 

Ever participated in 
job search activities 

Experimentals 

Controls 

Difference 

Ever participated in 
vocational training 

Experimentals 

Controls 

Difference 

Ever participated in 

post-secondary 

education 

Experimentals 

Controls 

Difference 

Ever participated in 
work experience 

Experimentals 

Controls 

Difference 



46.0 
7.0 
39.0 



0.0 
0.0 
0.0 



18.4 
4.1 
14.3 



12.3 
8.8 
3.5 



14.1 
13.5 
0.6 



4.9 
0.6 
4.3 



40.0 
3.2 
36.8 



0.0 
2.2 
-2.2 



11.6 
0.0 
11.6 



10.5 
6.5 
4.0 



12.6 
7.5 
5.1 



0.0 
0.0 
0.0 



25.2 
5.0 
20.2 



0.0 
1.2 

-1.2 



21.9 
0.0 
21.9 



9.0 
10.0 
-1.0 



9.7 
12.5 
-2.8 



0.6 

1.2 
-0.6 



35.0 
5.6 
29.4 



3.3 
0.0 
3.3 



25.0 
5.6 

19.4 *** 



8.3 
18.5 
-10.2 ** 



5.0 
3.7 
1.3 



1.7 
0.0 
1.7 



35.5 
5.6 
29.9 



0.0 
0.0 
0.0 



11.3 
0.8 
10.5 



7.3 

8.1 
-0.8 



13.7 
12.1 
1.6 



5.6 
0.0 
5.6 



36.3 
5.3 
31.0 



0.7 
0.7 
0.0 



17.6 
2.1 
15.5 *** 



9.5 
10.4 
-0.9 



11.0 
9.9 
1.1 



2.6 
0.4 

2 2 *** 



Ever participated in 
any activity 

Experimentals 

Controls 

Difference 



68.7 
29.2 
39.5 



64.2 
18.3 
45.9 



50.3 
27.5 

22.8 *** 



53.3 
27.8 

25.5 *** 



52.4 

25.0 
27.4 



57.8 
25.6 

32.2 *** 



Sample size 
Experimentals 
Controls 



163 
171 



95 
93 



155 
80 



60 
54 



124 
124 



597 
522 



ERLC 



SOURCE: MDRC calculations from the GAIN registrant survey for the TALS test sample. 

NOTES: Calculations for this table include all TALS test responders, Including those who did not participate 
in basic education. 

The TALS test sample includes AFDC-FG sample members from the five counties. Butte County was not 
included In the TALS test sample. 

The registrant survey was administered 26 to 37 months after random assignment, on average, 
across the five counties. See Appendix Table C.1 for further infornuition on the follow-up period in each 
county. 

"Post-secondary education** includes a srr^ll proportion of individuals (roughly 10 percent of participants) who 
attended high school. 

The "all county" estimate is the average of the county estimates, with each county weighted equally. 
A chi-square test was applied to differences between experimental and control groups. Statistical 
significance levels are indicated as = 1 percent; = 5 percent; * = 10 percent. 
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TABLE E.2 



FOR THOSE DETERMINED TO NEED BASIC EDUCATION: 
GAIN'S VNO- TO THREE-YEAR IMPACTS ON TALS SCORES 



Test and Score 


Experi mentals 


uonirois 


uinerence 


Document and quantitative literacy tests 








Combined average score 


475 


473 


1.8 


(difference/standard deviation) (a) 






1 .9% 


Scored at {%) 








Levels 3-5 on both 


18.0 


16.2 


1 .7 


Levels 3—5 on either 


36.0 


31.4 


4.5 * 


Document literacy test 








Average score 


238 


239 


—0.8 


{dnference/standard deviation) (a) 






— 1 .5% 


Scored at (%) 








Level 1 


31 .0 


29.3 


1 .7 


Level 2 


44.1 


48.5 


-4.4 


Level 3 


20.0 


18.3 


1.7 


Level 4 


4.9 


4.0 


0.9 


Level 5 


0.0 


0.0 


0.0 


Scored at {%) 








Levels 1~2 


75.1 


77.8 


-2.6 


Levels 3—5 


24.9 


22.2 


2.6 


Quantitative literacy test 








Average score 




2o4 




(difference/standard deviation) (a) 








Scored at {%) 








Level 1 


39.2 


40.9 


-1.6 


Level 2 


31.8 


33.8 


-2.0 


Level 3 


26.0 


23.2 


2.8 


Level 4 


2.8 


2.1 


0.7 


Level 5 


0.2 


0.0 


0.2 


Scored at (%) 








Levels 1-2 


71.0 


74.6 


-3.6 


Levels 3-5 


29.0 


25.4 


3.6 


Sample size 


595 


520 





SOURCE: MDRC calculations using GAIN TALS data. 

NOTES: Calculations for this table include all TALS responders, including those who did not 
participate in basic education. 

The TALS sample includes AFDC-FG sample members from Alameda, Los Angeles, 
Riverside, San Diego, and Tulare (Butte was not included In the TALS test sample). 

The TALS was administered with the registrant survey, 26 to 37 months after random 
assignment, on average, across the five counties. See Appendix Table C.1 for further information on 
the follow-up period in each county. 

Four sample members who took the TALS are not included In this table because they are 
missing identifying information. 

All counties are weighted equally in these estimates 

A two-tailed t-test was applied to differences between the experimental and control 
groups. Statistical significance levels are indicated as *** = 1 percent; ♦* = 5 percent; * = 10 percent. 

(a) The standard deviation of the outcome measure is for all controls, with counties weighted equally. 
Separate standard deviations were used for the combined score, the document literacy score, and the 
quantitative literacy score. 
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Lives of Promise, Lives of Pain: Young Mothers After New Chance. Monograph. 1994. Janet Quint, Judith 

Musick, with Joyce Ladner. 
New Chance: An Innovative Program for Young Mothers and Their Children. Brochure. 1993. 
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Project Redirection 

A test of a comprehensive program of services for pregnant and parenting teenagers. 

The Challenge of Serving Teenage Mothers: Lessons from Project Redirection. Monograph. 1988. Denise Polit. 
Janet Quint, James Riccio. 

The Community Service Projects 

A test of a New York State teenage pregnancy prevention and services initiative. 

The Community Service Projects: A New York State Adolescent Pregnancy Initiative. 1986. Cynthia Guy. 
772^ Community Service Projects: Final Report on a New York State Adolescent Pregnancy Prevention and 
Services Program. 1988. Cynthia Guy, Lawrence Bailis. David Palasits, Kay Sherwood. 



THE SCHOOL-TOWORK TRANSITION PROJECT 

A study of innovative programs that help students make the transition from school to work. 

772^ School'tO'Work Transition and Youth Apprenticeship: Lessons from the U.S. Experience. 1993. Thomas 
Bailey, Donna Merritt. 

Home-Grown Lessons: Innovative Programs Linking Work and High School. 1994. Edward Pauly, Hilary Kopp. 
Joshua Haimson. 

Learning Through Work: Designing and Implementing Quality Worksite Learning for High School Students. 
1994. Susan Goldberger, Richard Kazis, Mary Kathleen OTlanagan (all of Jobs for the Future). 



THE PARENTS' FAIR SHARE DEMONSTRATION 

A demonstration aimed at reducing child poverty by increasing the job-holding, earnings, and child support 
payments of unemployed, noncustodial parents (usually fathers) of children receiving public assistance. 

Caring and Paying: What Fathers and Mothers Say About Child Support. 1992. Frank Furstenberg, Jr., Kay 

Sherwood, Mercer Sullivan. 
Child Support Enforcement: A Case Study. Working Paper. 1993. Dan Bloom. 

772^ Parents' Fair Share Demonstration: Report on the Pilot Phase, Fortlicoming. Dan Bloom, Kay Sherwood. 

THE NATIONAL JTPA STUDY 

A study of 16 local programs under the Job Training Partnership Act (JTPA), the nation's job training system 
for low-income individuals. 

Implementing the National JTPA Study. 1990. Fred Doolittle, Linda Traeger. 

The National JTPA Study: Site Characteristics and Participation Patterns. 1993. James Kemple, Fred Doolittle, 
John Wallace. 

A Summary of the Design and Implementation of the National JTPA Study. 1993. Fred Doolittle. 
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About MDRC 



The Manpower Demonstration Research Corporation (MDRC) is a 
nonprofit social policy research organization founded in 1974 and 
located in New York City and San Francisco. Its mission is to design 
and rigorously field-test promising education and employment-related 
programs aimed at improving the well-being of disadvantaged adults 
and youth, and to provide policymakers and practitioners wi*.h reliable 
evidence on the effectiveness of social programs. Through this work, 
and its technical assistance to program administrators, MDRC seeks to 
enhance the quality of public policies and programs. MDRC actively 
disseminates the results of its research through its publications and 
through interchange with policymakers, administrators, practitioners, 
and the public. 

Over the past two decades - working in partnership with more than 
forty states, the federal government, scores of communities, and 
numerous private philanthropies ~ MDRC has developed and studied 
more than three dozen promising social policy initiatives. 
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